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SUBJECT:  Rqx>rt  on  DoD  Component  Implementing  Action  Plans  for  Improving  the 
QiMty  of  Spare  Parts  (Report  No.  94-079) 


We  are  providing  this  r^rt  for  your  review  and  comments.  This  is  the  second 
of  two  reports  on  the  DoD  Action  Plan  for  Continuously  Improving  the  Quality  of 
Spare  and  Rqiair  Parts.  Comments  on  a  draft  of  this  rqxirt  were  considered  in 
prqiaring  the  final  rqx>rt. 

DoD  Directive  7650.3  requires  that  all  audit  recomm^dations  be  resolved 
promptly.  The  Navy  comments  to  the  draft  of  this  report  were  fiilly  responsive. 

The  Deputy  Under  Secretary  of  Defense  (Logistics),  tiie  Army,  the  Air  Force,  and  the 
Defense  Logistics  Agency  comments  were  pmtiaUy  re^nsive.  Based  on  management 
comments,  we  revis^  two  recommendations.  We  request  the  Deputy  Under  Secretary 
of  Defense  (Logistics),  tiie  Army,  the  Air  Force,  and  the  Defense  Logistics  Agency  to 
provide  final  comments  on  the  imresolved  recommendations  by  June  13,  1994.  See  the 
table  at  the  end  of  each  finding  for  the  specific  requirements  for  your  response. 

We  appreciate  the  cooperation  and  courtesies  extended  to  the  audit  staff.  If 
you  have  any  questions  on  this  audit,  please  contact  Mr.  Salvatore  D.  Guli,  Audit 
Program  Director,  at  (703)  692-3025  (DSN  222-3025)  or  hfr.  C.  J.  Richardson,  Audit 
Projat  Manager,  at  (703)  692-3220  0SN  222-3220).  Copies  of  this  report  will  be 
distributed  to  the  organizations  listed  in  Appendix  G.  The  audit  team  memb^s  are 
listed  inside  the  back  cover. 


David  K.  Steensma 
D^uty  Assistant  Inspector  Goieral 
for  Auditing 
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DOD  COMPONENT  IMPLEMENTING  ACTION  PLANS  FOR 
IMPROVING  THE  QUALITY  OF  SPARE  PARTS 


EXECUTIVE  SUMMARY 


Introduction.  On  March  2,  1990,  the  Under  Secretary  of  Defense  for  Acquisition 
signed  the  DoD  Action  Plan  for  Continuously  Improving  the  Quality  of  Spare  and 
Rqiair  Parts  (the  DoD  Action  Plan).  The  DoD  Action  Plan  was  developed  in  response 
to  large  numbers  of  nonconforming  products  identified  in  the  Defense  supply  system 
during  1988  and  1989.  Die  DoD  Action  Plan  consists  of  26  objectives  formulated  to 
improve  the  DoD  qu^ty  assurance  program.  The  DoD  Action  Plan  was  presented  in 
March  1991  to  the  Senate  Committee  on  Governmental  Affairs  as  the  ovmm  PpD  plan 
for  continuously  improving  the  quality  of  spare  and  repair  parts.  In  ^dition,  the 
Inspector  General,  DoD,  accepted  implementation  of  the  DoD  Action  Plan  as 
satisfactory  management  response  to  audit  recommendations  design^  to  improve  the 
quality  assurance  of  spare  and  repair  parts  procurements.  Each  Military  Department 
and  the  Defense  Logistics  Agency  (DoD  Components)  issued  its  own  action  plan  to 
implement  the  DoD  Action  Plan. 

This  is  the  second  of  two  reports  on  the  DoD  Action  Plan.  Inspector  General,  DoD, 
Report  No.  93-(^l,  "Management  of  the  DoD  Action  Plan  for  Improving  the  Quality 
of  Spare  Parts,"  April  28,  1993,  states  that  after  1990,  the  Office  of  the  Secretary  of 
Defense  did  not  manage  and  monitor  implementation  of  the  DoD  Action  Plan  and  did 
not  revise  DoD  Action  Plan  objectives  and  milestones  to  refiect  changes  needed  for 
continuous  improvement  of  quality. 

Implementing  an  action  plan  can  result  in  a  one-time  improvement  in  the  quality  of 
spare  parts  procured.  Realizing  long-term  quality  goals  requires  continuous  actions 
resulting  from  consistently  update  action  plans.  Poor  quality  spare  parts  can  adversely 
affect  military  equipment  and  the  military  members  who  rely  on  the  spare  parts. 
However,  management  officials  responsible  for  implementing  the  action  plans  and  for 
achieving  continuous  quality  improvements  are  not  accountable  for  tiie  adverse  effects 
of  poor  quality. 

Objectives.  The  primary  audit  objective  was  to  evaluate  DoD  Component  plans  for 
implementing  the  DoD  Action  Plan.  Additionally,  we  were  to  determine  the 
effectiveness  of  internal  controls  for  verifying  that  DoD  Component  implementing 
action  plans  reflect  current  objectives,  initiatives,  performance  measures,  and 
milestones. 

Audit  Results.  The  initial  DoD  Component  implementing  action  plans  were  short¬ 
term  measures  designed  to  address  long-standing  quality  ^surance  problems.  While 
DoD  Components  have  continued  to  develop  initiatives  to  improve  the  quality  of  spare 
and  repair  parts,  implementing  action  plans  were  not  effectively  used  as  primary  tools 
for  managing  quality  programs. 
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o  The  DoD  Components  implementing  action  plans  did  not  include  the  bases 
for  holding  management  officials  accountable  for  achieving  quality  program  results. 
As  a  result,  DoD  Components  did  not  have  performance  measures,  milestones,  and 
feedback  mechanisms  to  measure  the  effectiveness  of  the  quality  program  (Finding  A). 

o  The  DoD  Components  did  not  have  complete  implenienting  action  plans 
because  changes  were  not  originated  to  add,  delete,  and  revise  the  ^tion  plan 
objectives  and  the  supporting  imtiatives.  Consequently,  the  action  plan  objectives  and 
initiatives  were  not  current  and  were  not  used  as  a  management  tool  for  continuously 
improving  the  quality  of  spare  and  repair  parts  (Finding  B). 

Internal  Controls.  Internal  controls  were  not  adequate  to  establish  the  accountability 
of  management  officials  for  the  action  plans.  Internal  controls  were  also  n^^  to 
verify  that  the  DoD  Component  implementing  action  plans  reflected  current  objectives, 
initiatives,  performance  measures,  and  milestones.  We  consider  these  internal  control 
weaknesses  to  be  material.  See  Part  I  for  the  internal  controls  reviewed  and  Finding  A, 
Part  n,  for  details  of  the  weatoesses. 

Potential  Benefits  of  Audit.  Implementation  of  the  recommendations  will  result  in 
better  action  plans  for  continuously  improving  the  quality  of  ^are  and  repair  parts. 
However,  we  are  unable  to  quantify  the  monetary  benefits  that  could  be  realized  by 
improving  the  quality  of  parts.  Appendix  E  summarizes  the  potential  benefits  of  the 
audit. 

Summary  of  Recommendations.  We  recommended  that  DoD  Components  update 
implementing  action  plans  every  2  years,  or  as  significant  events  occur,  and  establish 
accountability  of  management  officials  for  accomplishing  initiatives  in  the  action  plans, 
program  milestones,  and  performance  measures.  We  also  recommended  that  the 
Deputy  Under  Secretary  of  Defense  (Logistics)  select  a  standard  DoD  vendor  rating 
system  and  made  a  series  of  recommendations  to  the  DoD  Components  to  update  and 
revise  the  implementing  action  plans  to  reflect  current  or  planned  objectives  and 
initiatives. 

Management  Comments.  The  Navy  concurred  with  and  was  implemenimg 
recommendations  directed  to  it.  The  Deputy  Under  Secretary  of  Defense  (Logistics) 
agreed  to  evaluate  the  need  for  a  standard  DoD  vendor  rating  system.  The  Army  and 
the  Air  Force  generally  concurred  with  recommendations  directed  to  them.  The 
Defense  Logistics  Agency  only  partially  agreed  with  the  recommendations.  Each  of  the 
DoD  Components  agre^  to  revise  and  reissue  implementing  action  plans  but  disagreed 
that  they  lacked  accountability  for  quality  programs.  A  summaty  _  of  management 
comments  is  in  Part  n  and  the  full  text  of  management  comments  is  in  Part  IV  of  this 
report. 

Audit  Response.  The  Navy  comments  on  the  recommendations  are  fully  responsive. 
The  Deputy  Under  Secretary  of  Defense  (Logistics),  the  Army,  the  Air  Force,  and  the 
Defense  Logistics  Agency  comments  were  partially  responsive  to  the  intent  of  the 
recommendations.  £^s^  on  management  comments,  we  revised  our  recommendation 
to  ui^te  implementing  action  plans  every  2  years  by  adding  an  option  for  updating 
action  plans  as  significant  events  occur.  For  another  recommendation,  we  removed 
reference  to  and  limits  on  in-plant  quality  evaluations.  We  request  comments  from  the 
Deputy  Under  Secretary  of  Defense  Cl^gistics),  the  Army,  the  Air  Force,  and  the 
Defense  Logistics  Agency  by  June  13,  1994. 
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Introduction 


Background 


DoD  Response  to  Nonconforming  Parts.  On  March  2,  1990,  the  Under 
Secretary  of  Defense  for  Acquisition  issued  the  DoD  Action  Plan  for 
Continuously  Improving  die  Qu^ty  of  Spare  and  Repair  Parts  (DoD  Action 
Plan).  The  DoD  Action  Plan  was  issued  in  response  to  large  numbers  of 
nonconforming  products  identified  in  Inspector  General  (IG),  DoD,  Report 
No.  89-065,  "Nonconforming  Products  in  the  Defense  Supply  System  at  Warner 
Robins  Air  Logistics  Center,"  April  10,  1989  (Appendix  A). 

Progress  of  finproyements  in  the  DoD  Quality  Assurance  Program.  On 
March  6,  1991,  during  a  concessional  hearing  that  addressed  counterfeit  and 
substandard  products,  the  chairman  of  the  Senate  Committee  on  Governmental 
Affairs  expressed  frustration  over  the  progress  of  improvements  in  the  DoD 
quality  assurance  program.  The  chairman  noted  that,  during  a  1989  hearing, 
DoD  promised  to  improve  the  quality  assurance  program  in  response  to  Ae 
number  of  nonconforming  products  identified  at  Warner  Robins  Air  Logistics 
Center,  Robins  Air  Force  Base,  Georgia.  The  chairman  further  stated  that, 
since  ttie  1989  hearing,  the  IG,  DoD,  reported  that  a  lack  of  controls  at  all 
levels  routinely  allowed  the  acceptance  of  nonconforming  products  into  the 
DoD  logistics  system.  In  Sqptember  1990,  IG,  DoD,  Report  No.  90-113, 
"Nonconforming  Products  Procured  by  the  Defense  Industrial  Supply  Center," 
September  27,  1990,  showed  that  27  percent  of  1.3  biUion  parts  contain^ 
major  nonconformances  to  contract  specifications.  The  chairman  concluded  that: 

Clearly  something  is  wrong  with  the  way  our  procurement 
and  quality  control  systems  work.  The  Government  receives 
too  many  substandard  products.  Manu&cturers  and 
distributors  do  not  seem  to  be  concerned  widi  quality  and  do 
not  have  the  necessary  quality  control  systems . . .  Quality 
does  not  have  to  cost  more,  but  it  does  require  a  managemmit 
commitm^t  and  discipline. 

In  response,  the  DoD  representative,  the  Director,  Supply  Managemen^Policy, 
Office  of  the  Assistant  Secret^  of  Defense  (Production  and  Logistics),  agre^ 
that  a  problem  existed  regarding  nonconforming  parts.  The  Director  stated  that 
DoD  efforts  to  ensure  that  the  Government  gets  what  it  pays  for  were  wdl 
documented  in  an  action  plan  (the  DoD  Action  Plan).  The  DoD  representative 
stated  that; 

Our  DoD-wide  action  plan  was  formalized  in 
March  [1990]  .  .  .  The  hearings  held  prior  to  diat  point  by 
your  Committee,  and  similar  hearings  by  the  House  Defmise 
Readiness  Subcommittee,  helped  focus  the  attention  of  the 
highest  levels  of  DoD  management  on  the  problem  .  . .  The 
actions  we  have  already  taken  and  those  in  process  deal  with 


♦Supply  Management  Policy  is  now  in  the  Office  of  the  Assistant  Deputy  Under 
Secretary  of  Defense  (Materiel  and  Resource  Management),  Office  of  the 
Deputy  Under  Secretary  of  Defense  (Logistics).  The  Office  of  the  Assistant 
Secretary  of  Defense  (Production  and  Logistics)  was  disestablished. 


2 


Introduction 


all  phases  of  the  problem  and  are  designed  to  remove  non¬ 
conforming  items  from  the  current  inventory,  to  stop  new 
nonconforming  items  from  getting  in,  and,  of  course,  to 
oisure  that  bad  items  which  are  in  the  supply  warehouse  do 
not  get  issued  to  the  operating  and  maintenance  units  for  our 
weapons  systems  and  support  equipment. 

The  DoD  Components  plan  to  procure  an  estimated  $56  billion  of  spare  and 
repair  parts  from  FYs  1993  through  1997. 

DoD  Action  Plan  Organization.  The  DoD  Action  Plan  is  made  up  of 
26  objectives  divided  into  5  acquisition  phases:  pre-contract,  contract,  contract 
administration,  depot  (supply  management),  and  feedback  intelligence.  Each  of 
tile  26  objectives  contains  activities  for  implementation  of  that  objective,  with  a 
total  of  41  specifrc  activities  spelled  out  in  the  DoD  Action  Plan.  DoD  planners 
originally  assigned  either  a  1990  or  a  1991  milestone  to  ^ch  of  the 
41  activities.  A  description  of  the  26  DoD  Action  objectives  is  shown  in 
Appendix  B. 

DoD  Component  Implementing  Action  Plans.  In  a  March  2,  1990, 
memorandum,  the  Under  Secretary  of  Defense  for  Acquisition  directed  the 
Military  Departments  and  the  Defense  Logistics  Agency  (DLA)  (DoD 
Components)  to  provide  implementing  action  plans  within  90  days.  Each 
DoD  Component  used  the  5-phase,  26-objective  format. 

Terminology.  For  the  purposes  of  the  report,  the  term  "initiative"  will  be  used 
to  describe  the  implementing  actions  and  activities  the  DoD  Components 
described  in  their  implementing  action  plans.  The  terms  "products"  and  "spare 
and  repair  parts"  are  used  interchangeably. 


Objectives 


The  primary  audit  objective  was  to  evaluate  the  DoD  Component  plans  for 
implementing  the  DoD  Action  Plan.  Additionally,  we  were  to  determine  the 
effectiveness  of  internal  controls  for  verifyin|  that  the  DoD  Component 
implementing  action  plans  reflect  current  objectives,  initiatives,  performance 
measures,  and  milestones. 


Scope  and  Methodology 


Audit  Information,  Methodolo^,  and  Locations.  We  reviewed  the 
management  initiatives  taken  to  veri^  that  the  DoD  Components  appropriately 
updated  and  revised  tiieir  implementing  action  plans  to  reflect  current  quality 
assurance  policy  objectives  and  initiatives.  Our  evaluation  covered  management 
initiatives  from  July  1990  through  May  1993.  We  did  not  rely  on  computer- 
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processed  data  to  achieve  the  audit  objectives  or  use  statistical  sampling 
procedures  in  the  audit.  We  obtained  our  audit  information  primarily  from 
examination  of  the  DoD  Action  Plan;  the  DoD  Components'  implementing 
action  plans;  and  from  interviews  wiA  representatives  of  acquisition,  legal, 
supply,  and  quality  offices  of  tiie  DoD  Components.  We  contacted  National 
Inventory  Control  Points  and  maintenance  depots  in  the  Military  Departmrats 
regarding  use  of  the  action  plan.  We  did  not  contact  the  DLA  Defense  Supply 
Centers  and  Defense  depots.  Appendix  F  lists  the  organizations  visited  or 
contacted. 

Audit  Period  and  Standards.  This  program  audit  was  conducted  from 
August  1992  through  May  1993  in  accordance  with  auditing  standards  issued  by 
the  Comptroller  General  of  the  United  States  as  implemented  by  the  Inspector 
General,  DoD.  Accordingly,  the  audit  included  such  tests  of  internal  controls 
as  were  considered  necessary. 


Internal  Controls 


fritemal  Controls  Reviewed.  We  attempted  to  identify  internal  controls  within 
the  DoD  Components  for  assuring  that  implementing  action  plans  were 
maintained  to  reflect  current  objectives,  initiatives,  performance  measures,  and 
milestones  to  continuously  improve  the  quality  of  spare  and  repair  parts.  Also, 
we  attempted  to  identify  offices  of  primary  responsibility  for  each  objective  to 
determine  tfie  adequacy  of  oversight  and  responsibility.  The  DoD  Components 
had  no  internal  controls  in  their  internal  management  control  programs  to 
address  whether  management  officials  revised  and  updated  implementing  action 
plans. 

Liternal  Control  Weaknesses  IdentiHed.  The  audit  identified  material  internal 
control  weaknesses  as  defined  by  DoD  Directive  5010.38,  "internal 
Management  Control  Program,"  April  14,  1987.  The  DoD  Components  did  not 
revise  or  update  their  implementing  action  plans  to  verify  that  me  action  plans 
included  definite  performance  measures  to  assess  program  results  and  re^stic 
time-phased,  long-range  milestones  for  the  actions  needed  to  continuously 
improve  the  quality  of  spare  and  repair  parts. 

The  Amw,  and,  in  some  cases,  the  Navy  and  DLA  could  not  identi^  the 
offices  of  primaiy  responsibility.  The  Air  Force  identified  offices  of  primary 
responsibihty  for  each  objective.  In  addition,  the  offices  of  prim^ 
responsibility  in  all  DoD  Components  could  not  ^ways  provide  information 
about  their  assigned  objectives.  The  lack  of  responsibility,  oversight,  creditable 
performance  measures,  milestones,  and  accountability  in  the  DoD  Component 
implementing  action  plans  constituted  material  internal  control  weaknesses.  The 
recommendations  in  Finding  A,  if  implemented,  will  correct  the  internal  control 
weaknesses.  We  could  not  determine  the  monetary  benefits  that  will  result  from 
implementing  the  recommendations  because  the  lienefits  will  result  from  future 
actions  to  improve  the  quality  of  spare  and  repair  parts  procured.  Appendix  E 
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summarizes  the  potential  benefits  of  the  audit.  A  copy  of  the  rq>ort  will  be 
provided  to  the  senior  officials  responsible  for  internal  controls  within  the 
DoD  Components. 


Prior  Audits  and  Other  Reviews 


The  DoD  Action  Plan  was  the  subject  of  IG,  DoD,  R^rt  No.  93-091, 
"Management  of  the  DoD  Action  for  Improving  the  Quality  of  Spare 
Parts,"  April  28,  1993.  The  report  stated  that  the  Office  of  the  Assistant 
Secretary  of  Defense  (Production  and  Logistics^  did  not  manage  or  oversee 
implementation  of  the  DoD  Action  Plan  after  issuing  it.  Appendix  A  contains  a 
summary  of  seven  prior  IG,  DoD,  r^rts  with  findings  related  to  quality 
assurance  actions  for  nonconforming  products. 
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Finding  A.  Accountability  in 

Implementing  Action  Plans 

DoD  Component  implementing  action  plans  did  not  include  the  bases  for 
holding  management  officials  accountable  for  achieving  quality 
assurance  program  results  and  for  continuously  improving  the  quidity  of 
spare  and  repair  parts.  Implementing  action  plans  lacted  accountability 
because  the  DoD  Components  did  not  establish  definite  ^rformance 
measures  to  assess  program  results  and  did  not  set  realistic,  time-phased, 
long-range  milestones.  Li  addition,  the  DoD  Components  did  not 
develop  procedures  for  obtaining  feedback  from  the  users  of  spare  and 
repair  parts  regarding  the  adequacy  of  the  action  plans,  and  the  Army, 
the  Navy,  and  DLA  did  not  assign  or  reassign  responsibilities  for 
implementing  the  action  plans.  As  a  result,  the  DoD  Components  could 
not  use  the  implementing  action  plans  as  a  management  tool  for 
measuring  the  effectiveness  of  quality  program  results. 


Updated  Action  Plans 


When  the  DoD  Action  Plan  was  issued  in  March  1990,  no  provision  or  policy 
required  the  DoD  Components  to  update  their  implementing  action  plans. 
U^ated  action  plans,  reissued  every  2  years,  would  give  DoD  management  a 
means  to  track  quality  program  results,  improvements,  and  achievements  and  to 
maintain  the  action  plans  as  effective  management  tools.  The  current  status  of 
DoD  Component  implementing  action  plans  is  discussed  below. 

Army  Action  Plan  Issue  and  Update.  Headquarters,  Army  Materiel 
Command  (AMC),  develoj^  the  Army  Action  Plan  and  issued  the  plan  in 
July  1990.  The  Army  Action  Plan  was  similar  to  the  DoD  Action  Plan  and 
briefly  described  the  actions  to  implement  the  objectives.  The  Army  did  not 
reissue  an  updated  Army  Action  Plan  after  July  1990. 

Navy  Action  Plan  Issue  and  Update.  The  Assistant  Secretary  of  the  Navy 
(Research,  Development,  and  Acquisition)  issued  the  Navy  Action  Plan  in 
September  1990.  The  Navy  Action  Plan  listed  the  objectives  and  the  activities 
from  the  DoD  Action  Plan.  After  September  1990,  the  Navy  updated  their 
action  plan  for  use  in  a  1991  Senate  Committee  on  Governmental  Affairs 
hearing. 

Air  Force  Action  Plan  Issue  and  Update.  The  Air  Force  Logistics  Command 
developed  tfie  Air  Force  Action  Plan  and  issued  it  in  July  1990.  The  Air  Force 
Action  Plan  listed  the  objectives  in  the  DoD  Action  Plan  and  described  the 
initiatives  needed  to  implement  the  DoD  Action  Plan.  The  Air  Force  made 
minor  revisions  to  its  action  plan  and  reissued  the  Air  Force  Action  Plan  in 
April  1991. 
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DLA  Action  Flan  Issue  and  Update.  DLA  published  an  action  plan  m  August 
1989  and  then  published  a  revised  action  plan  in  May  1990  mat  listed  and 
described  initiatives  to  implement  the  26  objectives  in  the  DoD  Action  Plan. 
DLA  used  the  Action  Plan  as  a  corrective  measure  for  material  internal  control 
deficiencies  identified  for  nonconforming  products. 

DLA  developed  an  automated  version  of  the  DLA  Action  Plan  to  facilitate 
regular,  recurring  updates.  This  automated  DLA  Action  Plan  was  updated 
periodically  after  it  was  developed  in  1990.  However,  DLA  did  not  reissue  an. 
updated  version  of  the  DLA  Action  Plan  after  May  1990. 


Performance  Measures  To  Assess  Program  Results 


Government  Performance  Measurement.  Public  Law  103-62,  "Government 
Performance  and  Results  Act  of  1993,"  August  3,  1993  (the  Act),  provides  for 
the  establishment  of  strategic  planning  and  performance  measurement  in  the 
Federsd  Government.  The  Congress  found  that  Federal  managers  are  seriously 
disadvantaged  in  their  efforts  to  improve  program  efficiency  and  effectiveness 
because  of  insufficient  articulation  of  program  goals  and  inadequate  information 
on  program  performance.  Further,  congressional  policynming,  ending 
decisions,  and  program  oversight  are  seriously  handicapped  by  insufficient 
articulation  of  program  goals  and  inadequate  information  on  program 
performance.  The  Act  provides  for  performance  planning  that  establishes 
performance  goals  to  define  the  level  of  perform^ce  to  be  acMeved  by  a 
program  activity  and  expresses  goals  in  an  objective,  quantifiable,  and 
measurable  form.  The  Act  is  pertinent  to  the  DoD  Action  Plan  and  DoD 
Component  implementing  action  plans. 

The  Act  emphasizes  management  accountability  in  two  areas: 

o  Improve  the  confidence  of  the  American  people  in  the  capability  of 
the  Federal  Government  by  systematically  holding  Federal  agencies  accountable 
for  achieving  program  results. 

0  Improve  Federal  program  effectiveness  and  public  accountability  by 
promoting  a  new  focus  on  results  service  quality,  and  customer  satisfaction. 
The  DoD  Component  implementing  action  plans  lacked  the  detail  and  specificity 
n^ed  to  support  either  of  the  two  goals. 

The  initiatives  for  implementing  the  26  objectives  in  the  DoD  Action  Plan  are 
primarily  short-range  actions  and  do  not  represent  a  long-range  plan  to 
continuously  improve  the  quality  of  spare  and  repair  parts.  The 
DoD  Component  implementing  action  plans  were  one-time  responses  that 
reflected  the  DoD  plan  and  did  not  describe  time-phased,  long-range  activities 
and  initiatives  for  each  objective. 
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Performance  Measures  in  DoD  Component  Implementing  Action  Plam. 
The  Military  Departments  did  not  include  performance  measures  in  their  action 
plans.  DLA  included  performance  measures  for  the  objectives  in  the  DLA 
Action  Plan.  However,  DLA  performance  measures  were  not  always 
meaningful  and  did  not  provide  for  the  quantifiable  measure  of  progress  firom 
established  baselines.  For  example,  DLA  described  the  following  programs  as 
performance  measures  for  objective  18,  identify  and  purge  nonconforming 
materiel  from  wholesale  level  inventoiy.  The  performance  measures 
are  quality  control  and  product  quality  audit  results,  technit^  assis^ce  and 
operational  reviews,  and  quality  assurance  man^ement  review  visits.  The 
objective  18  performance  measures  do  not  provide  for  aiwthing  other  than 
ongoing  management  programs  and  do  not  describe  quantifiable  measures  of 
progress  such  as  reduc^  nonconformances  from  an  established  baseline.  DLA 
does  have  a  laboratory  testing  program  that  reports  continuous  reductions  in 
nonconforming  products.  DLA's  use  of  the  laboratory  testing  program  can 
provide  a  performance  measure  that  provides  quantifiable  results. 


Setting  Action  Plan  Milestones 


The  DoD  Components  did  not  establish  realistic  milestones  to  reflect  the  long¬ 
term  commitment  required  to  remedy  the  major  problems  that  result  in  the 
procurement  of  nonconforming  parts  or  the  distribution  of  nonconforming 
products  from  the  Defense  supply  system. 

DoD  Action  Plan  Milestones.  The  milestones  in  the  DoD  Action  Plan  and  in 
the  DoD  Component  action  plans  were  near-term  dates  that  called  for 
completion  in  1990  or  1991.  As  of  June  1,  1993,  only  one  objective  was 
completed.  Objective  1,  standardizing  the  definitions  for  a  nonconformance, 
was  completed  in  April  1991  when  DoD  revised  the  Defense  Federal 
Acquisition  Regulation  Supplement  to  include  standard  definitions  for 
nonconformances.  The  definition  was  also  included  in  Joint  Service  Regulation 
DLA  Regii^tion  4155.24,  "Product  Quality  Deficiency  Report  Program."  Of 
the  26  objectives  in  the  DoD  Action  Plan,  21  objectives  applied  to  the  Military 
Departments.  The  Military  Dq)artments  do  not  have  a  role  in  objectives  10, 
12,  13,  14,  and  17  because  tiiese  objectives  address  quality  assurance  in 
contractor  plants  and  dqwts  receiving  inspections,  which  are 
DLA  responsibilities. 

Military  Department  MUestones.  The  Army  did  not  establish  definite 
milestones  for  14  of  the  21  objectives,  tiie  Navy  did  not  establish  defiiute 
milestones  for  15  of  the  21  objectives,  and  the  Air  Force  did  not  establish 
definite  milestones  for  18  of  the  21  objectives.  The  lack  of  definite  milestones 
reflects  a  lack  of  accountability  and  a  questionable  commitment  to  the  action 
plan  objectives. 
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DLA  Milestones.  All  26  objectives  applied  to  DLA,  and  DLA  provided  near- 
term  (1989  and  1990)  milestones  for  14  of  the  26  objectives  in  the  DLA  Action 
Plan.  Howevor,  DLA's  use  of  near-term  milestones  understated  the  long-range 
problems  associated  with  most  of  the  DoD  Action  Plan  objectives. 


Assigning  Responsibilities  and  Obtaining  Feedback 


The  DoD  Components  relied  heavily  on  their  headquarters  quality  assurance 
organizations  to  develop  their  implementing  action  plans  and  to  k^p  track  of 
die  offices  that  were  primarily  responsible  for  the  subject  areas  covert  by  each 
objective  in  the  DoD  Component  implementing  action  plans. 

Functional  Reorganizations  Resulting  in  Reduced  Quality  Assurance 
Staffs.  Since  1991,  die  DoD  Components  reorganize  the  functional 
organizations  that  were  responsible  for  managing  their  implementing  action 
pl^s  and  monitoring  implementation  of  the  DoD  Action  Plan.  The 
reorganizations  results  in  reductions  of  quality  assurance  staff.  After  the 
reorganizations  and  staff  reductions,  we  determined  that  the  DoD  Components 
did  not  formally  assign  or  reassign  reqxmsibility  for  all  of  the  objectives, 
actions,  and  initiatives  in  their  implementing  action  plans. 

Army.  Since  1990,  three  separate  organizations  at  AMC  merged  to  become 
one,  resulting  in  a  reduction  in  staff  size.  The  offices  of  Deputy  Chiefs  of  Staff 
for  Product  Assurance  and  Testing,  Production,  and  Research  and  Development 
merged  to  become  the  Office  of  the  Deputy  Chief  of  Staff  for  Research, 
Development,  and  Engineering.  The  quality  assurance  function,  originally  part 
of  the  office  of  die  Deputy  Chief  of  Staff  for  Product  Assurance  and  Testing, 
was  reduced  from  about  SOpwple  to  5.  The  Army  Action  Plan  did  not 
specifically  assign  responsibility  for  objectives  to  offices  of  primary 
responsibility.  AMC  assigned  one  person  to  answer  all  questions  regarding  the 
Army  Action  Plan. 

During  our  audit  visits,  officials  at  the  Army  Mssile  Command  and  Corpus 
Chiisti  Army  Depot  did  not  have  copies  of  the  Army  Action  Plan  and  had  not . 
provided  any  feedback  to  AMC  on  the  adequacy  of  the  Army  Action  Plan. 

Navy.  The  Navy  Action  Plan  did  not  s^ifically  assign  responsibility  for 
objectives  to  offices  of  primary  responsibility.  Tne  Navy  was  not  able  to 
readily  identify  the  correct  office  to  answer  questions  regarding  four  Navy 
Action  Plan  objectives.  During  our  audit  visits,  officials  at  the  Navy  aviation 
depots  and  Navy  shipyards  did  not  have  copies  of  the  Navy  Action  Plan  and  the 
officials  could  not  produce  any  record  of  providing  feedback  to  higher 
headquarters  regarding  the  adequacy  of  the  Navy  Action  Plan. 

Air  Force.  Effective  July  1,  1992,  the  Air  Force  Logistics  Command  and  the 
Air  Force  Systems  Command  merged  to  become  the  Air  Force  Materiel 
Command.  Three  Air  Force  Materiel  Command  directorates,  Engineering, 
Contracting,  and  Logistics,  have  quality  assurance  functions.  As  of  June  1993, 
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the  Engineering  Directorate  assumed  overall  responsibili^  for  quality  assurance. 
After  Ae  merger,  the  Air  Force  Materiel  Command  quauty  assurance  staff  was 
r^uced  from  15  to  5  people.  The  Air  Force  Action  Plan  cited  the  offices  of 
primary  responsibility  for  all  26  objectives,  and  the  ^ints  of  contact  were 
knowledgeable  about  each  objective.  Officios  at  the  air  logistics  centers  that 
we  visit^  knew  about  the  Air  Force  Action  Plan  but  had  not  provided  feedback 
regarding  its  adequacy  or  implementation. 

DLA.  Li  March  1993,  DLA  reorganized  from  19  headquarters  principal  staff 
elements  and  21  field  organizations  that  reported  direct  to  the  Director  of 
DLA  to  only  three  management  business  areas  reporting  to  the  Director.  The 
management  business  areas  are  Acquisition,  Materiel  Management,  and 
Corporate  Administration.  The  19  headquarters  principal  staff  elements  were 
merged  into  executive  and  management  teams.  The  Quality  Assurance 
Directorate,  wWch  was  primarily  responsible  for  the  DLA  Action  Plan,  was 
eliminated.  Quality  assurance  functions  were  assigned  to  the  Materiel 
Management  and  Acquisition  business  areas.  Responsibility  for  the  DLA 
Action  Plan  now  resides  with  Materiel  Management.  The  DLA  Action  Plan 
cited  the  offices  of  primary  responsibility  for  aU  26  objectives,  but  the  points  of 
contact  for  6  objectives  could  not  answer  basic  questions  and  did  not  know 
whom  to  contact  to  obtain  answers  regarding  the  initiatives  under  the  objective. 
DLA  did  not  distribute  the  DLA  Action  Plan  to  the  users  of  spare  and  repair 
parts  for  feedback. 


Conclusion 


The  DoD  Action  Plan  is  an  important  planning  document  created  to 
substantially  improve  quality  assurance.  The  need  for  a  life-cycle  quality 
assurance  action  plan  was  demonstrated  in  two  different  audits  that  reported 
high  rates  of  nonconforming  products  accqited  into  the  Defense  sufiply  system. 
The  purpose  of  independent  quality  assurance  organizations  is  to  keep 
management  focused  on  the  need  for  improving  quality.  When  quality 
assurance  is  integrated  into  organizations,  formal  plans  to  continuously  improve 
quality  are  essential.  Unless  implementing  action  plans  include  commitments  to 
definite  performance  measures,  milestones  for  continuous  long-range 
improvement,  and  the  active  involvement  of  personnel  from  headquarters  and 
field  organizations,  DoD  Components  jeopardize  the  quality  assurance  for  an 
estimate  $56  billion  of  future  spare  and  repair  part  procurements  from 
FYs  1993  through  1997. 
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Recommendations,  Management  Comments,  and  Audit 
Response 


Revised  Recommendation.  Based  on  management  comments,  we  revised 
Recommen^tion  1.  to  give  greater  flexibility  to  the  DoD  Components  for 
determining  when  to  update  their  implementing  action  plans. 

We  recommend  that  the  Assistant  Secretaries  of  the  Army  and  Navy  (Research, 
Developm^t,  and  Acquisition),  the  Assistant  Secretary  of  the  Air  Force 
(Acquisition),  and  the  Director,  Defense  Logistics  Agency: 

1.  Establish  policies  to  reissue  updated  plans  for  implementing  the 
DoD  Action  Plami  for  Continuously  Improving  the  Quality  of  Spare  and 
Repair  Farts  either  every  2  years  beginning  in  FY 19S^  or  as  signiflcant 
changes  occur  in  the  five  acquisition  phases  of  quality. 

Army  and  Air  Force  Comments.  The  Army  concurred  with  the  intent  of  the 
recommendation,  but  commented  that  the  2-year  requirement  does  not  allow  for 
sufficient  time  to  implement  changes  and  measure  results.  The  Army  stated  that 
it  should  decide  when  to  update  the  Action  Plans  based  on  initiative 
requirements  and  as  deemed  necessary.  The  Air  Force  concurred  with  the 
intent  but  believed  the  Air  Force  Action  Plan  should  be  updated  as  required 
rather  than  on  a  fixed  schedule. 

Audit  Response.  Because  of  the  Army's  lack  of  management  attention  to  the 
original  Army  Action  Plan,  some  requirement  for  up^ting  the  Action  Plan 
must  be  established.  We  recommrad  that  Action  Plan  updates  occur  either  in  a 
specified  time  flame  or  when  a  significant  change  occurs  in  the  acquisition 
phases  of  quality.  We  have  modified  our  recommendation  to  include  significant 
changes  in  the  acquisition  phases  of  quality  as  a  reason  for  modifying  the  2-year 
timeframe.  Accordingly,  we  request  the  Army  to  reconsider  and  to  provide 
comments  to  the  final  report.  We  request  that  the  Air  Force  provide  comments 
on  toe  revised  recommendation  in  its  comments  on  toe  final  report. 

Navy  Comments.  The  Navy  concurred  and  stated  that  it  submitted  an  updated 
Navy  implementation  plan  in  December  1993.  In  addition,  toe  Navy  {ilann^  to 
update  toe  Navy  action  plan  as  significant  changes  occurred  and  make  it  a  living 
plan. 

DLA  Comments.  DLA  nonconcurred,  disagreeing  with  a  poliw  to  reissue  an 
updated  plan  for  implementing  toe  DoD  Action  Plan  every  2  years.  DLA 
contended  that  although  toe  May  1990  DLA  Action  Plan  was  not  updat^  in 
hard  copy,  it  was  maintained  in  an  automated  format  and  was  a  living 
document.  DLA  stated  that  toe  automated  aspects  of  toe  plan  contributed 
significantly  to  improving  toe  tracking  of  initiative  status  and  keeping  toe 
initiatives  current  and  on  track  for  successful  initiative  completion.  In 
December  1993,  DLA  prepared  a  hard  copy  update  to  its  implementing  ^tion 
plan.  DLA  sta^  that  it  may  or  may  not  publish  another  hard-copy  edition  of 
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its  implementing  action  plan  in  FY  1996.  If  no  further  hard-copy  DLA 
implementing  action  plans  are  published,  quality  initiatives  will  be  integrated 
into  the  DLA  strategic  plans,  business  plans,  and  business  processes. 

Audit  Response.  DLA's  characterization  of  its  May  1990  implementing  action 
plan  as  a  living  document  is  not  accurate.  From  January  1992  through 
May  1993,  the  DLA  automated  version  of  the  implementing  action  plan  was 
largely  inactive.  The  automated  version  as  of  hfey  1993  showed  that  DLA 
offices  of  primary  interest  had  not  updated  the  status  of  IS  of  the  26  action  plan 
objectives  during  1992.  DLA  accomplished  only  one  update  from  January 
through  May  1993.  In  April  1993,  we  requested  a  meeting  with  representatives 
from  die  offices  of  i>rimajy  interest  to  verify  r^)eated  reports  mat  DLA  no 
longer  was  interested  in  mamtaining  an  implementing  action  plan.  The  Deputy 
Director  for  Quality  Assurance,  along  with  representatives  from  Contract 
Policy,  Supply,  Technical  Operations,  and  Information  Systems,  determined 
mat  mey  did  not  know  how  DLA  management  felt  about  continuing  and 
reissuing  me  DLA  implementing  action  plan  and  mat  mey  would  have  to 
respond  to  our  query  at  a  later  date.  DLA  did  not  provide  an  official  answer  to 
our  question.  We  modiried  our  recommendation  to  include  significant  changes 
in  me  acquisition  phases  of  quality  as  a  reason  for  modifying  me  2-year 
timeframe.  Accordingly,  we  request  DLA  to  reconsider  its  response  and 
provide  comments  on  me  final  report. 

2.  Establish  accountability  for  achieving  implementing  action  plan 
objectives  and  for  improving  the  quality  of  spare  and  repair  parts  by: 

a.  Updating  implementing  action  plans  to  include  detailed 
in-process  and  planned  initiatives  for  DoD  Action  Plan  objectives. 

b.  Updatii^  implementing  action  plans  to  contain  performance 
measures  to  measure  the  effectiveness  of  each  initiative  in  accomplishing 
DoD  Action  Plan  objectives. 

c.  Updating  implementing  action  plans  to  include  definite,  realistic, 
and  obtainable  milestones  for  completion  of  initiatives  in  the  action  plans. 

d.  Assigning  organizational  responsibility  for  management  oversight 
for  implement^  action  plan  objectives  and  for  obtaining  feedback  on  the 
adequacy  of  the  initiatives  supporting  the  objectives. 

Army,  Navy,  and  Air  Force  Comments.  The  Army  concurred  and  stated  mat 
me  Army  Materiel  Command  will  u;^te  and  reissue  me  action  plan  by  June  1, 
1994.  The  revised  action  plan  will  include  performance  measures  and  realistic 
milestones  and  will  assign  organizations  responsibility  of  management 
oversight.  The  Navy  concurred  and  stated  mat  it  was  developing  a  Task  Action 
Team  to  identify  n^ed  objectives,  meaningful  activities  to  accomplish  mese 
objectives,  and  performance  measures  to  evaluate  me  success  of  me  program 
and  milestones  by  February  1994.  The  Air  Force  concurred  but  stated  mat  me 
content  of  me  Air  Force  Action  Plan  depended  on  me  guidance  received  from 
me  Office  of  me  Secretary  of  Defense . 
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Audit  Response.  We  request  the  Air  Force  to  provide  a  date  by  which  it  plans 
to  reissue  the  Air  Force  implementing  action  plan. 

DLA  Comments.  DLA  nonconcurred,  but  stated  that  it  had  develop^  a  hard¬ 
copy  update  that  included  in-process  and  planned  initiatives;  a  combination  of 
quantitative  and  qualitative  performance  measures  that  include  overall  measures 
of  product  quality  that  were  applicable  to  jdl  objectives;  definite,  realistic,  and 
obtainable  milestones  for  completion  of  the  initiatives;  and  points  of  contact 
with  organizational  responsibility  for  management  oversight  of  each  initiative  in 
the  action  plan.  DLA  took  exception  to  distributing  the  plan  to  the  users  of 
DLA-suppfled  spare  parts  because  no  r^uirement  mdsts  to  do  m.  DLA 
asserted  tiiat  customers  are  not  interested  in  how  DLA  plans  to  verify  that  its 
spare  parts  are  not  defective. 

Audit  Response.  DLA's  reliance  on  overall  measures  of  product  quality  based 
on  laboratory  testing  is  not  appropriate  for  all  objectives.  DLA  uses  the 
issuance  of  policy  and  the  development  of  regulations  as  performance  measures. 
DLA  should  also  include  the  extent  of  policy  implementation  as  performance 
measures  as  well.  Formulating  a  policy  by  a  certain  date  is  not  a  complete 
performance  measure;  a  complete  performance  measure  includes  a  measure  of 
the  actual  implementation  of  the  policy.  DLA  customers,  the  Service's 
National  Inventory  Control  Points  and  maintenance  depots,  are  interested  in 
DLA  plans  for  improving  receipt,  storage,  distribution,  and  quality  assurance 
functions  related  to  the  parts  that  the  Services  purchase  and  manage.  DLA  has  a 
responsibility  under  any  total  quality  environment  to  solicit  fe^back  firom  its 
customers  on  DLA-proposed  methods  for  improving  and  maintaining  the  quality 
of  spare  parts.  We  request  that  DLA  reconsider  its  reiqionse  in  comments  on 
the  final  report 


Response  Requirements  For  Each  Recommendation 


Responses  to  the  final  report  are  required  from  the  addressees  shown  for  the 
items  indicated  witii  an  "X"  in  the  following  table. 


Response  Should  Cover; 


Number 

Addressee 

Concur/ 

Nonconcur 

Proposed 

Action 

Completion 

Date 

Material 
Internal  Control 
Weakness 

1. 

Army 

X 

X 

X 

X 

Air  Force 

X 

X 

X 

X 

DLA 

X 

X 

X 

X 

2. 

Air  Force 

X 

X 

DLA 

X 

X 

X 

X 
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Management  Comments  and  Audit  Response  on  the  Finding 


Anny  Comments.  The  Army  concurred  with  issuing  a  revised  action  plan  but 
did  not  concur  with  the  audit  report  statements  that  the  internal  management 
control  weaknesses  were  material.  The  Army  uses  several  methods  besides  the 
implementing  action  plan  to  achieve  improveo  quality.  The  original  Army  plan 
was  not  intended  to  be  a  long-range  response.  Conclusions  drawn  in  the  report 
that  material  weaknesses  exist  are  based  on  the  premise  that  the  original  plans 
were  intended  to  serve  as  long-range  responses  to  this  area. 

Navy  Comments.  The  Navy  concurred  with  issuing  a  revised  action  plan  but 
did  not  concur  with  Finding  A  or  with  the  conclusions  that  the  deficiencies 
concerning  the  Navy  implementing  action  plan  constituted  material  internal 
control  weaknesses.  The  existence  of  major  programs  to  improve  the  quality  of 
spare  and  r^air  parts  such  as  the  Red,  Ydlow,  Green  Program  demonstrate  the 
Navy's  intent  to  be  a  leader  in  this  effort.  The  Navy  stated  that  the  DoD  Action 
Plan  for  Continuously  Improving  the  Quality  of  Spare  and  Rraair  Parts  was  a 
short-range,  immediate  response  to  IG,  DoD,  Report  No.  89-065.  The  Navy 
implementing  action  plan  was  designed  to  be  only  one  of  the  many  tools  used  by 
Navy  to  effect  improvements  to  the  quality  of  spares  and  repair  parts.  The 
short-term  basis  of  the  DoD  Action  Plan,  and  the  requirement  that  DoD 
Component  implementing  action  plans  address  only  the  items  contained  in  the 
DoD  Action  Plan  precluded  the  use  of  the  Navy  implementing  action  plan  as  a 
management  document. 

Air  Force  Comments.  The  Air  Force  concurred  with  issuing  a  revised  action 
plan  and  partially  concurred  with  the  intent  of  Finding  A  while  providing 
several  comments.  The  Air  Force  noted  that  the  DoD  Action  Plan  does  not 
contain  a  statement  that  indicates  that  the  DoD  Action  Plan  was  not  to  be  used 
as  a  long-range  planning  document.  In  fact,  the  Air  Force  considered  the  DoD 
Action  Plan  to  be  a  long-range  document  when  it  was  used  as  the  basis  for 
developing  the  Air  Force  implementing  action  plan.  The  Air  Force  bdieved 
that  a  plan  that  was  written  in  1990  and  had  milestones  out  to  1995,  or  that  were 
on-going,  must  be  considered  a  long-range  document. 

The  Air  Force  implementing  action  plan  followed  the  organization  of  the  DoD 
Action  Plan.  The  Air  Force  implementing  action  plan  is  only  one  of  many  tools 
used  to  assure  that  the  Air  Force  obtains  quality  parts.  As  such,  quality 
improvement  verification  should  be  a  materM  commander's  initiative  rather 
than  an  internal  control  checklist  item.  The  Air  Force  believes  that  the  auditors 
misinterpreted  the  significance  of  Air  Force  initiatives  and  milestones  as  they 
related  to  performance  measures  and  long-range  milestones.  The  Air  Force 
believes  that  supervisors  responsible  for  the  mitiative  can  use  the  "action" 
portions  and  the  milestones  to  measure  their  progress  without  including  a  formal 
requirement  for  each  initiative.  Further,  supervisors  further  up  the  command 
chain  can  use  the  action  portions  of  the  plan  in  the  same  manner. 

Audit  Response.  The  Air  Force  is  correct  that  the  DoD  Action  Plm  does  not 
contain  any  statement  that  it  is  not  a  long-range  document.  In  addition,  DoD 
Material  Management  Regulation  4140. 1-R,  dated  January  3,  1993,  provides 
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the  requirement  for  the  DoD  Components  to  maintain  action  plans  for 
continuously  improving  the  qualitjj  of  ^are  parts.  DoD  4140. 1-R  also  provides 
for  tile  use  of  post-acceptance  testing  as  a  significant  quality  assurance  tool.  In 
a  February  8,  1994,  memorandum  to  the  Office  of  the  Inspector  General,  the 
Deputy  Under  Secretary  of  Defense  proposed  to  include  the  following  statement 
in  a  revised  version  of  DoD  4140. 1-R: 

. .  .  .The  DoD  Con^nents  shall  develc^  action  plans.  . .  .to  raisure 
continuous  improvem^t  in  die  quality  of  secondary  items.  The^ 
plans  should  include  performance  measures  and  milestones  in 
iqiplicahle  acquisition  phases  and  docum^t  actions  and 
accomplishments  that  implem^t  quality  program  objectives. 

Our  recommendations  to  improve  the  DoD  Components  implementing  action 
plans  were  intended  to  help  identify  and  define  existing  problems  with  the 
qualify  of  spare  parts.  The  identification  of  problems  and  the  continuous 
process  to  implement  programs  for  improvement  are  the  primary  bases  for 
improving  qualify  programs.  TTie  DoD  Component  iniplementing  action  plws 
should  document  the  entire  compendium  of  programs,  initiatives,  and  activities 
for  addressing  the  problems  identified  with  quality.  As  DoD  gravitates  toward 
the  use  of  commercial  products  and  the  use  of  international  qualify  standards, 
new  challenges  for  maintaining  qualify  spare  parts  will  emerge.  The  DoD 
Components  implementing  action  plans,  complete  with  performance  measures 
and  milestones,  provide  tiie  documentation  and  accountabilify  needed  to 
establish  each  organization's  commitment  to  continuous  qualify  improvemoit. 
The  Office  of  the  Under  Secretary  of  Defense  has  recogniz^  the  need  for 
verifying  accountabilify  in  qualify  programs  by  agreeing  to  mclude  performance 
measures  and  milestones  in  revisions  to  DoD  4140. 1-R  as  requirements  for 
implementing  action  plans. 

DLA  Comments.  DLA  nonconcurred  and  stated  that  responsibilify  was 
assigned  for  each  objective  in  the  DLA  implementing  action  plan  to  offices  of 
primary  interest.  Senior  officials  within  these  offices  were  held  accountable  for 
each  action  plan  objective,  the  milestones,  performance  measures,  and  status 
updates,  as  well  as  periodic  briefings  to  eifter  the  DLA  Director  or  Deputy 
Director.  Many  of  the  May  1990  DLA  implementing  action  plan  initiatives 
were  completed  with  positive  results  confirmed  through  the  DLA  laboratory 
testing  programs.  '!^e  DLA  Depufy  Director  personally  monitored  the 
implementing  action  plan  as  evidenced  through  numerous  pieces  of 
correspondence  that  the  Depufy  Director  sent  to  the  officers  of  primary  interest. 
The  Depufy  Director  chaired  periodic  implementing  action  plan  status  update 
briefings  and  invited  the  Deputy  Inspector  General,  DoD,  to  attend  one  of  the 
status  update  briefings. 

DLA  further  stated  that  the  DLA  implementing  action  plan  contained  definite, 
realistic,  and  obtainable  milestones  for  identified  initiatives.  The  DLA 
initiatives  were  not  all  short-term,  one-time  responses.  Many  of  the  initiatives 
were  quite  extensive  and  still  continue.  DLA  cited  such  programs  as  IQUE, 
best  vmue  contracting,  GIDEP,  and  the  laboratory  testing  program  as  programs 
tiiat  still  continue.  DLA  disagreed  that  the  use  of  near-term  initiatives  by  DLA 
understated  long-range  problems. 
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DLA  also  stated  that  defmite  and  realistic  peifonnance  measures  were 
established  for  each  initiative  in  the  DLA  implementing  action  plan.  Qualitative 
(accomplishment-oriented)  measures  wete  identified  for  each  milestone  to  track 
completion  of  initiatives.  The  quality  of  DLA  procured  parts  dramatically 
improved,  which  indicated  that  meaningful  initiatives  were  in  the  DLA 
implementing  action  plan  and  that  the  plan  was  used  effectively  as  a 
management  tool. 

In  addition,  DLA  disagreed  with  audit  report  statements  that  DLA  performance 
measures  were  not  always  meaningtiil  and  did  not  provide  for  quantifiable 
measures  of  progress  from  established  baselines.  The  DLA  performance 
measures  were  not  used  for  just  ongoing  programs.  The  on-going  programs  had 
results  that  could  be  quantified.  DLA  ^so  stated  that  its  oveim  approach  to 
performance  measurement  was  to  assess  the  effectiveness  of  quality  initiatives 
with  both  qualitative  and  quantitative  measures.  DLA's  overall  measure  of 
product  quality,  such  as  random  laboratory  testing  results,  are  the  important 
Action  Plan  performance  measures.  DLA  also  disagreed  with  the  audit  report 
statement  that  "DLA  did  not  reissue  an  updated  version  of  the  DLA  Action 
Plan  a^r  May  1990,"  on  the  basis  that  DLA  used  an  automated  version  that 
was  updated  periodically  to  ensure  a  continually  current  DLA  implementing 
action  plan.  In  addition,  DLA  disagreed  with  me  implication  inherent  in  the 
audit  report  statement  that  the  DLA  points  of  contact  for  six  objectives  could 
not  answer  basic  questions  and  did  not  know  whom  to  contact  to  obtain  answers 
regarding  the  initiatives.  The  IG,  DoD,  audit  was  conducted  concurrent  with  a 
complete  DLA  reorganization,  and  the  auditors  were  asked  to  inform  the  DLA 
point  of  contact  whether  additional  assistance  was  required  to  obtain  satirfactory 
answers.  During  the  reorganization,  a  temporary  situation  existed  in  which  new 
action  officers  may  not  have  had  full  knowledge  of  previous  actions.  The 
IG,  DoD,  should  have  provided  DLA  the  opportunity  to  find  the  appropriate 
action  officers. 

Audit  Response.  DLA  led  the  DoD  Components  in  the  development  of 
initiatives,  especially  laboratory  testing,  to  verify  the  quality  of  spare  parts. 
DLA  implemented  the  short  range  objectives  that  were  included  in  the 
implementing  action  plan  and  for  a  portion  of  the  time  from  1990  through  1993, 
DLA  actively  managed  the  plan.  However,  DLA's  characterization  of  the 
management  of  the  DLA  implementing  action  plan  is  not  accurate  for  a 
17-month  period  spanning  January  1,  1992  through  May  30,  1993.  We 
reviewed  copies  of  Ae  automated  versions  of  the  DLA  implementing  action  plan 
and  found  that  only  11  of  the  26  objectives  were  updated  during  1992  and  only 
1  of  the  26  objectives  were  updated  during  the  first  5  months  of  1993.  AftM 
repeated  statements  from  representatives  of  the  offices  of  primary  interest  that 
DLA  was  no  longer  interested  in  maintaining  an  implementing  action  plan  and 
that  our  audit  was  addressing  an  issue  of  the  past,  we  requested  a  meeting  in 
April  1993  with  the  official  rqiresentatives  of  the  offices  of  primary  interest  to 
determine  DLA's  official  position  regarding  the  maintenance  and  eventual 
reissue  of  the  action  plan.  The  DLA  representatives  were  uncertain  and  told  us 
that  they  would  ask  the  Office  of  the  Director  of  DLA  and  would  respond  to  our 
inquiry  at  a  later  date.  We  did  not  get  an  official  response  but  learned  later  in 
September  1993  that  DLA  intended  to  update  and  rdssue  the  DLA 
implementing  action  plan. 
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The  finding  is  accurate.  The  DoD  Components  did  not  have  adequate  internal 
controls  to  hold  officMs  accountable  for  setting  and  managing  rustic,  long- 
range,  time-phased  milestones  to  accomplish  objectives  and  initiatives  that 
reflect  current  problems  and  for  measuring  progress  _  ^ough  definite  and 
quantifiable  performance  measures.  DLA  claim^  tiiat  initiatives  were  complete 
once  policy  was  formulated  and  issued.  The  initiatives  with  short-range 
milestones,  once  completed,  were  not  updated  to  reflect  the  next  step  toward 
continuous  process  improvement.  The  automated  status  updates  that  we 
reviewed  showed  an  accumulation  of  completed  initiatives  that  left  the 
impression  teat  no  further  management  actions  were  needed.  For  example,' 
DLA  showed  that  tee  action  on  "best-value  buying"  was  wmplete  when  a 
source  selection  handbook  was  issued  in  1990.  No  other  actions  or  initiatives 
were  developed  for  tee  continuous  improvement  and  implementation  of  best- 
value  buying.  In  our  opinion,  issuance  of  tee  hwdbook  constitute  a  start,  not 
a  completion.  Further,  tee  lack  of  description  associated  with  tee  DLA 
initiatives  and  performance  measures  depicts  a  lack  of  openness  and  an 
unwillingness  to  be  held  accountable  for  all  aspects  of  tee  quality  program. 

On  July  22,  1991,  tee  Deputy  Inspector  General,  DoD,  attended  a  status  update 
briefing  on  tee  DLA  implementing  action  plan.  The  Deputy  Inspector  General 
critici^  DLA's  qualitative  performance  measures  because  tee  perfonnance 
measures  were  not  quantifiable  measures  of  progress  from  establish^  baselines. 

We  agree  teat  laboratory  test  results  can  be  a  good  overall  measure  of  quality. 
However,  DLA  needs  initiatives  for  verifying  tee  integrity  of  test  plans  ^d  test 
results,  as  well  as  initiatives  for  verifying  tee  completeness  of  supporting  test 
plans,  teitiatives  teat  support  verification  are  critical  to  tee  viability  of  tee 
performance  measure.  In  addition,  DLA  needs  specific  ^tmtifiable  measures 
for  verifying  tee  effectiveness  of  tee  initiatives  in  tee  acquisition  phases  such  as 
best  value  buying,  process  vstedation  at  contractor  pl^ts,  and  PQDR  trend 
analyses.  If  DLA  policies  and  procedures  are  not  implemented,  teen  low 
nonconformance  rates  from  tee  laboratory  testing  program  may  be  questionable. 

Lastly,  we  had  difficulty  obtaining  information  from  various  DLA  offices 
because  tee  personnel  in  those  offices  demonstrated  a  lack  of  interest  in 
continued  management  of  tee  implementing  action  plan.  We  recogniz^  that  tee 
DLA  reorganization  was  a  factor  but  we  believe  teat  DLA  representatives  were 
reluctant  to  claim  responsibility  for  tee  objectives  in  the  implementing  action 
plan.  We  notified  tee  DLA  point  of  contract  each  time  we  had  a  problem,  and 
after  some  searching,  another  representative  was  provided.  The  new 
representatives  were  not  always  knowledgeable  about  tee  implementing  action 
plan  objective.  We  extended  our  audit  until  we  were  satisfied  teat  we  were 
provid^  tee  best  answers  available  from  DLA. 
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The  DoD  Components  did  not  have  complete  implementing  action  plans 
because  changes  were  not  initiated  to  add,  ddete,  and  revise  the 
objectives  and  the  supporting  initiatives  related  to  pre-contract,  contract, 
contract  administration,  d^t  (supply  management),  and  feedb^k 
intelligence  phases  of  the  action  plans.  Consequently,  die  implementing 
action  plans  did  not  reflect  current  quality  program  objectives  and 
initiatives  and  were  not  used  as  a  managemrat  tool  for  continuously 
improving  the  quality  of  spare  and  repair  parts. 


Initiatives  in  the  Acquisition  Phases 


Since  1990,  the  DoD  Components  either  completed  or  have  ongoing 
92  significant  initiatives  to  improve  the  quality  of  spare  parts  (Appendix  C). 
The  following  bar  graph  shows  the  number  of  ongoing  and  completed  initiatives 
for  each  DoD  Component. 


Number  of  Initiatives  Ongoing  and  Complete  for  Each  DoD  Component 

The  bar  graph  demonstrates  that  DLA  aggressively  pursued  significant  quality 
assurance  initiatives.  The  details  in  Appendix  C  show  that  DLA  developed 
47  initiatives,  and  the  Military  Departments  developed  45  initiatives.  The  DoD 
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Components  had  80  initiatives  that  supported  objectives  in  the  pre-contract, 
contract  administration,  and  feedback  intelligence  phases.  The  DoD 
Components  had  12  initiatives  in  the  contract  and  depot  (supply  management) 
phases. 

The  1990  DoD  Components  implementing  action  plans  showed  that  plaimed 
short-tom  initiatives  were  never  completed  and  that  many  of  the  1990  imtiatives 
would  not  result  in  significant  changes  or  improvements  in  quality  assurance. 
This  report  does  not  address  every  possible  initiative  that  could  affect  the  quality 
of  spare  parts.  Tbe  initiatives  that  DoD  Components  i^ould  improve  or  add  to 
their  revised  implementing  action  plans  are  discussed  in  each  acquisition  pha^ 
below.  When  tiie  action  plans  are  revised,  the  DoD  Components  w^ 
significantly  update  and  tailor  tiieir  action  plans  to  their  individual  needs  in 
accordance  with  the  over^  guidmce  provided  by  the  Office  of  the  Secretary  of 
Defense. 


Pre-Contract  Phase 


The  objectives  in  the  pre-contract  phase  are  designed  to  establish  prograins  that 
will  support  sound  award  decisions.  The  primary  qu^ity  issue  areas  in  the 
pre-contract  phase  are  contractor  past  performance  information,  contractor 
quality  assurance,  vendor  ratings,  and  technical  data. 

Contractor  Fast  Performance  Information.  A  contractor's  past  performance 
record  is  a  key  indicator  for  predicting  future  performance.  Past  performance 
systems  are  continuous  efforts  to  collect  and  record  past  performance 
information  for  subsequent  use  in  determining  contractor  eligibility  and 
selection.  Past  performance  information  is  used  in  objective  4  of  the 
DoD  Action  Plan,  encourage  the  use  of  quality  factors  in  the  source  selection 
process  for  spare  and  repair  parts. 

To  make  past  performance  information  available  to  DLA  contracting  officers, 
DLA  designed  the  Contractor  Profile  System  to  link  a  variety  of  data  bases  that 
contain  contractor  information.  Die  1989  Defense  Management  ^port  to  the 
President  also  recognized  the  need  for  i^st  performance  information. 
DLA  chartered  the  Past  Performance  Coor^ating  Council  to  develop  a 
DoD-wide  means  of  collecting  relevant  historical  contractor  performance  data 
for  use  in  source  selection,  to  promote  information  exchange  between  the 
Military  Dqiartments,  and  to  develop  an  automated  past  performance 
information  system.  Die  Past  Performance  Coordinating  Council  designated  the 
DLA  Contractor  Profile  System  as  the  DoD  system  for  collecting  contractor 
past  performance  information.  The  DLA  Action  Plan  should  desoribe  DLA 
actions  to  satisfy  the  DoD  requirement  to  collect  contractor  past  performance 
information  as  part  of  an  objective  to  tiie  pre-contract  phase. 

Vendor  Rating  Systems.  DoD  Components  are  developing  separate  automated 
analytical  systems  to  evaluate  past  performance  information  as  a  source  selection 
factor.  These  automated  systems  compile  and  analyze  information  such  as  past 
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delivery  delinquencies  and  product  quality  deficiencies.  _  We  identified 
10  systems  in  various  stages  of  development  and  implem^tation  to  accumulate, 
track,  and  evaluate  contractor  past  performance  (Appendix  D).  The  Navy  has  a 
mature  vendor  rating  system,  tiie  Red,  Yellow,  Green  Program,  that  ra^ 
contractors  based  on  the  degree  of  risk  associated  with  contractor  quality 
performance  for  specific  products.  Contractors  who  supply  spare  parts  to  the 
DoD  Components  have  complained  about  the  confusion  in  satisfying  the  varying 
requirements  for  numerous  rating  systems.  DoD  needs  to  use  a  standard 
approach  for  rating  vendor  performance.  The  DoD  Components  _  should  add 
standardization  of  vendor  rating  systems  to  their  implementing  action  plans  as 
an  objective  to  the  pre-contract  phase. 

Technical  Data.  Competitive  procurement  of  spare  and  repair  parts  for  weapon 
systems  requires  the  availability  of  adequate  and  accurate  technical  ^ta. 
Technical  data  include  aigineering  drawings  and  associated  lists,  specifications, 
standards,  process  sheets,  catalog  item  identification  and  rdat^  infonnation, 
and  data  relating  to  test  or  inspection  of  hardware  items.  DoD  Action  Plan 
objective  2  is  to  ensure  technical  data  are  available,  ad^uate,  and  accurate  for 
use  in  acquiring  quality  parts.  DoD  guidance  for  technical  data  is  contained  in 
DoD  5010. 12M,  "Procures  for  the  Acquisition  and  Management  of  Technical 
Data,"  May  1993. 

In  January  1991,  DLA  executed  a  memorandum  of  agreement  with  the  Military 
Departments  that  provided  guidance  for  Defense  hfena|ement  Report 
Decision  926,  "Consumable  Item  Transfer  Program,"  regarding  transfer  of 
consumable  item  management  firom  the  Militeiry  Departments  to  DLA.  The 
memorandum  of  agreement  provides  criteria  for  the  Military  Dq)artments  to 
transfer  complete  technical  data  packages  to  DLA. 

The  hfilitary  Departments  are  responsible  for  maintaining  technical  data; 
however,  ensuring  that  technical  data  are  available,  adequate,  and  accurate  is 
a  responsibility  that  DLA  must  share  with  the  Military  Departments.  The 
DoD  Components  have  a  program  for  recording  all  engineering  d^  in  the 
Military  Engineering  Data  Asset  Locator  System,  or  MEDALS,  which  should 
make  technical  data  readily  available.  However,  the  implementing  action  plans 
contain  only  one  initiative  for  ensuring  that  technical  data  are  adequate  and 
accurate.  The  initiative,  for  objective  2,  requires  the  DoD  Components  to 
ensure  technical  data  are  available  before  the  breakout  of  parts  for  competition. 

The  DoD  Components  initiatives  wore  not  adequate  to  develop  and  process 
changes  to  technical  data  used  to  acquire  spare  and  repair  parts.  The  initiatives, 
which  consist^  of  "reporting  quarterly"  and  "writing  nmagement  requirements 
to  automate  the  breatout,"  <ud  not  effectively  identify  and  correct  existing 
problems  with  poor  quality  technical  data. 

Two  recent  audits  substantiate  this  point.  The  General  Accounting  Office  report 
GAO/NSIAD-92-23,  "Defense  Procurement,  Improvement  Needed  in  Technical 
Data  Management,"  February  1992,  reported  that  19  of  23  contractors  visi^ 
during  the  Generd  Accounting  Office  audit  had  experience  problems  with 
deficient  data  such  as  illegible  drawings,  out-of-date  information,  and  inaccurate 
or  incomplete  material.  In  addition,  IG,  DoD,  Report  No.  94-071,  "Report  on 
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the  Transfer  of  the  Management  of  Consumable  Items  to  the  Defense  Logistics 
Agency,"  March  31,  1994,  reported  that  20perc^t  of  the  items  requiring 
techni^  data  packages  in  the  audit  sample  were  incomplete  (see  Appendix  A 
for  details).  The  DoD  Components  should  update  objective  2  in  thdr 
implementing  action  plans  to  include  current  or  planned  initiatives  to  ensure 
technical  data  are  available,  adequate,  and  accurate  for  use  in  acquiring  quality 
spare  and  repair  parts. 


Contract  Phase 


The  objectives  in  the  contract  phase  should  result  in  initiatives  to  reduce  the 
risks  associated  with  procuring  and  accepting  products  lat^  found  to  contain 
patent  defects.  The  primary  quality  issue  areas  in  the  contract  phase  include 
critical  aircraft  and  ship  parts  and  contractual  initiatives  for  certificates  of 
quality  compliance,  and  finality  of  acceptance. 

Critical  Aircraft  and  Ship  Farts.  United  States  Code,  title  10,  section  2383 
(10  U.S.C.  2383),  "Procurement  of  Critical  Aircraft  and  Ship  Spare  Parts," 
requires  contractors  supplying  critical  aircraft  and  ship  parte  to  meet  appropriate 
qu^fication  and  contractual  quali^  re(}uiremente.  Beginning  in  April  1989,  the 
Secretary  of  Defense  was  required  to  implement  10  U.S.C.  2383,  which  states 
"in  procuring  any  spare  or  repair  part  that  is  critical  to  the  operation  of  an 
aircraft  or  smp,  me  Secretary  of  Defense  shall  require  the  contractor  supplying 
the  part  to  provide  a  part  that  meets  all  appropriate  qualitication  and  contractual 
quality  requirements  as  may  be  specified  and  made  available  to  prospective 
offerers."  DoD  has  not  implements  this  law  into  regulations  and  does  not  have 
plans  to  do  so.  DoD  plans  to  request  repeal  of  10  U.S.C.  2383  in  its  current 
acquisition  reform  efforts. 

If  efforts  to  repeal  this  statute  fail,  then  the  DoD  Components  should  revise 
objective?,  to  ensure  all  suppliers  of  ^are  and  repair  parte  meet  specified 
qimty  and  technical  requirements,  to  include  an  initiative  to  require  compliance 
with  10  U.S.C.  2383. 


Contractual  Initiatives.  The  DoD  Components  do  not  have  effective  plans  for 
using  contract  clauses  to  reduce  the  risks  associated  with  the  unknowing 
procurement  of  nonconforming  products  with  patent  defects.  The  planned 
initiatives  to  reject  or  require  correction  of  nonconforming  products  and  to 
provide  incentives  for  contractors  to  continuously  reduce  pr<Muction  process 
variability  needed  improvement.  The  initiatives  did  not  provide  a  contractual 
basis  for  recoupment  or  replacement  for  products  found  to  have  patent  defects 
after  acceptance. 

Certificate  of  Quality  Compliance.  The  DLA  Action  Plan  attempted 
to  address  the  problem  of  procuring  nonconforming  products  with  the  use  of 
certificates  of  quality  compliance  (COQC).  A  COQC  provides  a  record  of  who 
manufactured  Ae  part  and  detailed  records  of  objective  quality  inspections  and 
test  results.  COQCs  were  used  for  critical  items  or  problem  items  such  as 
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class  3  fasteners.  The  purpose  of  the  COQC  was  to  hold  distributors  to  the 
same  quali^  standards  as  manufacturers.  &  the  certificates  are  not  included 
with  the  shipment,  depot  inspectors  will  not  accept  the  shipment.  Developing 
and  processing  COQCs  are  expensive,  and  acceptance  of  products  on  a  COQC 
was  final,  even  when  the  products  were  later  identified  to  contain  patent  defects. 

Finality  of  Acceptance.  Federal  Acquisition  Regulation  S2.246-2, 
"Inspection  of  Siq)plies— Fixed  Price,”  provides  Aat  accq>tance  is  final  even  for 
products  containing  patent  defects.  &  our  opinion,  contractors  who  deliva' 
nonconforming  prc^ucts  will  continue  to  do  so  under  current  rules  for  finality  of 
acceptance  on  products  with  patent  defects.  The  contractors  recognize  the 
minimum  level  of  quality  controls  required  to  obtain  product  acceptance  and 
will  not  correct  inadequate  quality  controls  until  their  products  are  rejected. 
The  finality  of  acceptance  is  contrary  to  U.S.  business  practices.  According  to 
the  quali^  control  standards  promulgated  by  the  American  National  Standard 
for  Quality  Systems,  the  supplier  is  req>onsible  for  providing  acceptable 
product,  and  the  supplier  remains  responsible  for  a  product  that  is  rejected  after 
the  purchaser  initially  verifies  product  nonconformance.  The  Navy,  for 
example,  recognized  me  need  for  reducing  the  risk  of  accepting  poor  quality 
products  when  it  awarded  a  1993  contract  for  the  ALQ-99  electronics 
countermeasure  receiver.  The  contract  contained  a  clause  stating  that  the 
receivers  would  be  free  from  defects  in  materid  and  workmanship  and  would 
continue  to  operate  for  60  months  regardless  of  Government  inspection  and 
acceptance.  If  a  defect  was  found,  the  contractor  was  required  to  promptly 
correct  or  replace  the  item. 

An  audit  recommendation  in  IG,  DoD,  Report  No.  92-099,  "Quality  Assurance 
Actions  Resulting  from  Electronic  Component  Screening,"  June  8,  1992,  to 
revise  Federal  Acquisition  Regulation  52.246-2  was  not  accepted  because  the 
recommended  revision  could  produce  warranty-like  price  con^uences  for 
about  five  million  National  Stock  Numbered  items.  Representatives  from  the 
offices  of  the  Director  of  Defense  Procurement;  the  IG,  DoD;  and  DLA  agreed 
tiiat  a  better  solution  would  be  to  target  intensive  pre-acceptance  inspections  for 
products  tendered  by  suppliers  who  consistently  shipped  nonconforming 
products  problem  suppliers).  However,  when  necessaty,  a  contract  clause 
could  be  used  to  eliminate  the  finality  of  accq>tance  ror  selected  problem 
contractors  and  on  contracts  for  products  vulne^le  to  nonconformances  in 
specific  contracts.  DLA  agreed  to  identify  problem  suppliers  and 
nonconforming  products  and  to  develop  contractiim  initiatives  to  address  the 
acceptance  of  products  with  patent  defects.  The  DLA  solution  was  to  include 
policy  propo^  to  obtain  recoupments  for  products  accepted  by  the 
Government,  but  which  w^  later  foimd  to  contain  patent  defects.  The  DoD 
Components  should  revise  objectives,  to  reject  or  require  corrections  of 
nonconforming  products,  to  show  the  planned  and  ongoing  contractual 
initiatives  that  provide  the  Government  with  a  basis  for  recoupment  or 
replacement  for  products  found  to  have  patent  defects  after  accqitance. 
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Contract  Administration  Phase 


The  initiatives  in  the  contract  administration  phase  were  designed  to  reduce  the 
chances  that  DoD  contractors  will  tender  nonconforming  products  to  the 
Government  for  acceptance.  DLA  is  responsible  for  quality  assurance  contract 
administration  in  DoD.  The  primary  quality  issue  areas  in  the  contract 
administration  phase  are  In-Plant  Quality  Evaluation  (IQUE)  Progr^, 
international  quality  standards,  waivers  and  deviations,  and  Material  Review- 
Boards. 

In-Plant  Quality  Evaluation.  The  focus  of  the  IQUE  Program  is  to  improve 
quality  by  continuously  improving  contractor  production  processes  instead 
of  detecting  nonconformances  in  the  completed  product.  The  IQl^,  Progr^ 
provides  DLA  acquisition  officials  an  analytical  approach  for  determining  which 
production  processes  affect  quality.  Quality  assurance  r^resentatives  have 
more  authority  and  flexibility  under  the  IQUE  Progr^  to  tailor  their  programs 
to  fit  manufacturing  conditions.  DLA  published  policy  and  procedures  for  the 
IQUE  Program  in  DLA  Manual  8200.5,  "In-Plant  Quality  Evaluation," 
October  1990.  The  manual  provides  guidance  to  the  quality  assurance 
representatives  in  the  Defense  Contract  Management  Command  (DCMC). 

DCMC  routinely  discusses  possible  contractor  improvement  areas  with 
contractor  management.  However,  the  DLA  Action  Plan  does  not  incorporate 
plans  for  measuimg  and  describing  the  progress  of  DoD  contractors  m  ^hieving 
the  continuous  improvement.  An  iititiative  for  measuring  and  describing  DoD 
contractor  progress  in  the  IQUE  Program  is  needed  under  objective  14,  to 
measure  effectiveness  of  in-plant  Government  contract  administration  and 
contractor  performance. 

International  Quality  Standards.  Senior  acquisition  officials  of  the  Military 
Departments  signed  a  memorandum  March  8,  1993,  that  authorized  the  use  of 
commercial  standards  provided  in  the  International  Organization  for 
Standardization  9000  series  (ISO  9000)  and  equivalent  American  National 
Standards  Institute-American  Society  for  Quality  Control  (ANSI/ASQC  Q^O) 
quality  system  series.  However,  the  memorandum  did  not  provide  detailed 
guidance  on  how  the  commercial  standards  would  be  applied. 

The  Assistant  Secretary  of  Defense  (Production  and  Logistics)  expressed 
concerns  to  the  Military  Departments  in  a  April  2,  1993,  memorandum,  about 
Ae  lack  of  detailed  guidance  on  application  of  the  ISO  9000/Q90  smies.  In 
addition,  the  Assistant  Secretary  statM  that  DoD  personnel  were  not  trained  to 
administer  ISO  9000/Q90  series  standards. 

DLA  is  responsible  for  training  the  quality  assurance  representatives  that  must 
administer  quality  standards  for  DoD  procurements.  DLA  needs  to  include 
initiatives  in  the  DLA  Action  Plan  for  the  trdning  required  for  quality  assurance 
under  the  ISO  9000/Q90  series  standards  as  part  of  objective  12,  update  in-pl^t 
Government  quality  assurance  procedures  to  provide  Govemmait  quality 
assurance  representatives  flexibility  to  tailor  oversight. 
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Waivers  and  Deviations.  Contracting  officers  have  the  authority  to  grant 
waivers  for  products  that  do  not  conform  to  contract  sp^ifications. 
Additionally,  contracting  officers  may  giant  deviations  from  contract 
specifications.  The  extent  to  which  waivers  and  deviations  were  allowed  in 
previous  contracts  can  provide  contracting  officials  with  additional  quality 
information  in  the  contract  award  process. 

The  1990  DLA  Action  Plan  contained  an  initiative  to  include  information 
regarding  waivers  and  deviations  in  the  contractor  profile  data  base.  DLA  has 
not  completed  actions  to  make  a  data  base  of  waivmrs  and  deviations  granted  to 
each  contractor  available  to  Gov^ment  contracting  officers.  DLA  has 
develop^  a  mathematical  model,  the  Quality  Effectiveness  S^sing  Technique, 
to  provide  a  relative  measure  of  contractor  quality  assurance  effectiveness.  The 
mrmel  includes  Material  Review  Board  actions  and  waivers  in  the  data  base. 
DLA  records  waivers  and  deviations  in  the  Quality  Effectiveness  Sensing 
Technique  system.  The  number  of  waivers  and  deviations  should  decrease  for 
each  DoD  contractor.  DLA  plmis  to  analyze  and  evaluate  the  waivers  and 
deviations  that  are  approved  through  the  Quality  Effectiveness  Sensing 
Technique.  DLA  needs  an  initiative  to  evaluate  the  extent  of  waivers  and 
deviations  through  the  Quality  Effectiveness  Sensing  Technique  for 
objective  10,  reduce  contractor  Material  Review  Board  actions  and  requests  for 
waivers  or  deviations. 

Material  Review  Boards.  Contractors  establish  hifoteiial  Review  Boards  to 
determine  the  disposition  and  correction  of  minor  nonconforming  parts 
identified  before  Government  acceptance.  IG,  DoD,  Report  No.  89-065  stated 
that  contractors  did  not  identify  and  correct  the  causes  of  recurring 
nonconformances  and  that  Government  quality  assurance  rq;>resentatives 
accroted  the  recurring  nonconformances.  As  Government  contractors  continue 
to  improve  their  in-process  manufacturing  quality  controls,  the  number  of 
Material  Review  Boards  actions  should  decline.  DLA  needs  an  initiative  to 
analyze  and  evaluate  Material  Review  Board  activity  at  contractor  plants 
through  the  Quality  Effectiveness  Sensing  Technique  as  part  of  objective  10. 


Depot  (Supply  Management)  Phase 


The  initiatives  in  the  depot  (supply  management)  phase  were  designed  to 
identify  and  purge  major  and  criticd  nonconforming  products  stored  in  Defense 
depots  and  to  ensure  that  only  conforming  products  are  shipped  to  operational 
imits.  The  responsibility  for  supply  management  is  spread  among  the  DoD 
Components.  The  DoD  Components  are  responsible  for  managing  the  items 
assigned  to  them,  whereas  DLA  is  solely  responsible  for  receiving,  storing,  and 
distributing  all  depot  storage  items.  The  piimaty  quality  issue  areas  in  the  depot 
(supply  management)  phase  include  parts  testing  and  the  quality  assurance  of 
repackaged  items.  Parts  testing  is  also  a  quality  issue  area  in  the  feedback 
intelligence  phase. 


26 


Finding  B.  Adequacy  of  Implementing  Action  Plans 


Army.  The  Army  included  initiatives  in  its  implementing  action  plan  to  test 
new  receipts  to  teep  nonconforming  products  from  entering  the  inventory. 
However,  the  Army  did  not  implement  the  initiatives.  The  Amy  Action  Plan 
did  not  include  initiatives  to  test  parts  alr^y  in  wholesale  (depot)  inventories. 
The  Army  should  implement  existing  initiatives  to  test  new  receipts  for 
nonconforming  products  and  should  revise  its  implementing  action  plan  to  add 
initiatives  to  test  and  identify  products  already  m  the  wholes^  (depot) 
inventories.  The  Army  also  needs  to  establish  initiatives  for  testing  suspect 
product  lines  under  objective  18,  to  identify  and  purge  nonconforming  products 
from  wholesale  level  inventory. 

Navy.  The  Navy  included  initiatives  in  its  implementing  action  plan  to  test  new 
receipts  to  keep  nonconforming  products  from  entering  tiie  inventory  but  did  not 
implement  the  initiatives.  The  Navy  Action  Plan  did  not  include  initiatives  to 
test  parts  that  were  in  wholesale  (depot)  inventories.  However,  the  Navy  did 
test  some  diesel  parts  stored  in  de^ts.  In  1991,  the  Navy  completed  the  Diesel 
Engine  Parts  Improvement  Program  to  test  and  purge  nonconforming  parts  from 
the  supply  system.  The  Navy  still  has  plans  to  expand  the  testing  program  to 
gas  turbine  engines,  pumps,  and  air  conditioning  units  but  needs  to  include 
toose  plans  under  objective  18. 

Air  Force.  In  August  1989,  the  Air  Force  develop^  the  Conformance 
Verification  Program  to  identify  nonconforming  parts  in  wholesale  (dqwt) 
inventories  and  to  purge  the  nonconforming  parts.  Originally,  the  Conformance 
Verification  Program  addressed  parts  already  in  the  inventory  at  the  air  logistics 
centers.  The  Aur  Force  encountered  problems  with  this  program  and  found  it 
difficult  to  administer.  The  Air  Force  found  that  recoupments  for 
nonconforming  parts  were  difficult  because  the  parts  fleeted  were  from  old 
contracts  and  were  not  properly  identified.  Ii  addition,  contractors  who 
supplied  some  of  the  parts  refused  to  discuss  old  contract  orders  because 
acceptance  of  nonconforming  products  with  patent  defects  was  final.  Because 
of  tile  difficulties  eiqieiienc^,  in  June  1990  the  program  emphasis  was  shifted 
to  new  receipts.  Since  that  time.  Conformance  Verification  Program  managers 
have  not  tes^  potentially  nonconforming  parts  in  the  Air  Force  inventory.  The 
Air  Force  should  establish  an  initiative  under  objective  18  to  test  suspect 
product  lines  as  part  of  the  Conformance  Verification  Program. 

DLA.  Products  may  be  unusable  because  they  are  repac^ged  improperly  at 
Defense  depots.  Conducting  quality  assurance  inspections  before  issuing 
repackaged  products  from  Defense  depots  should  be  included  as  an  objective  in 
the  depot  phase.  An  objective  covering  qu^ty  inspection  of  repackaged 
products  is  needed  because  repackaged  products  issued  from  depot  s^ks  do  not 
always  contain  the  contract  number,  the  contractor's  identification,  or  the 
National  Stock  Number.  If  those  data  are  not  on  the  package,  the  product 
cannot  be  used  in  controlled  manufacturing  operations.  During  our  visits  to  the 
Portsmouth  Naval  Shipyard  and  the  Corpus  Christi  Army  Depot,  production 
managers  complained  that  DLA  depots  often  supplied  repackaged  products  that 
were  either  improperly  identified  or  damaged.  Production  managers  had  to  stop 
manufacturing  or  repair  operations  until  the  depots  supplied  mther  correctly 
identified  or  undamaged  parts. 
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Feedback  Intelligence  Phase 


The  initiatives  in  the  feedback  intelligence  phase  were  designed  to  identify 
product  lines  susceptible  to  nonconformances  and  the  problem  contractors  that 
supply  nonconfomung  products  so  that  quality  assurance  efforts  are  targeted  to 
preclude  accratance  of  nonconforming  products  from  problem  contractors. 
primary  quahty  issue  areas  in  the  finback  intelligence  phase  are  the  quality 
PQDR  Program,  tiie  DoD-wide  deficiency  rqwrting  system,  and  independent 
qu^ty  assurance  testing. 

PQDR  Program.  The  PQDR  Program  was  designed  in  part  to  identify  and 
purge  nonconforming  products  from  the  inventory  and  to  provide  feedback  to 
contracting  officers  and  contractors.  The  PQDR  Program  was  to  provide  for 
cross-reporting  of  nonconforming  products  between  the  DoD  Components,  for 
necessary  corrective  actions  throughout  the  acquisition  and  support  process,  and 
to  maintain  contractor  quality  history.  Additioi^y,  the  PQDR  Program  was  to 
provide  the  initial  reporting,  cause,  correction,  and  status  accoun^g  of 
individual  product  quality  deficiencies.  The  program  data  are  used  to  identify 
problems,  trends,  and  recurring  defidendes.  The  DoD  Components  need  to 
include  ^ditiond  initiatives  for  feedback,  reporting,  data  exchange,  and 
definitions. 

PQDR  Feedback.  National  inventory  control  points  are  the  action 
points  for  most  PQDRs.  As  the  action  points,  quality  assurance  organizations  at 
each  national  inventory  control  point  are  responsible  for  processing  and 
investigating  PQDRs  and  for  ensuring  that  corrective  action  is  completed. 
Investigating  a  PQDR  involves  determining  its  validity,  detemtining  the  extent 
of  nonconforming  products  in  the  inventory,  and  establishing  a  basis  for 
recoupment  of  nonconforming  products  suppli^  by  contractors. 

PQDRs  provide  valuable  quality  information  to  contractors  on  applicable  quality 
controls  and  to  contracting  officers  on  the  contractors’  performance.  IG,  DoD, 
Report  No.  93-066,  "Recoupments  for  Quality  Defects,"  March  10,  1993, 
stated  that  DLA  Defense  Supply  Centers  did  not  perform  complete  qualify 
assurance  investigations  because  qualify  assurance  specialists  frequently 
curtailed  investigations  of  PQDRs  without  validating  quality  deficiencies 
through  product  testing  or  through  verification  witii  me  supplier.  Defense 
Supply  Centers  did  not  screen  inventory  for  other  nonconforming  products. 
Consequentiy,  the  Defense  Supply  Centers  ^sumed  the  risk  of  continuing  to 
issue  nonconforming  products  to  DoD  activities  after  receiving  repeated  PQDRs 
on  the  same  contract.  We  found  similar  problems  at  the  hfilitary  Department 
sites  Aat  we  visited  during  this  audit  and  during  previous  reviews  and  audify. 
The  DoD  Components  n^  initiatives  to  verify  reported  qualify  deficiencies 
through  product  testing  or  through  verification  with  the  supplier  as  part  of 
objective  23,  to  improve  the  customer  complaint  system. 

Reporting  Nonconforming  Products.  In  IG,  DoD,  Report 
No.  90-113,  a  statistical  sample  was  used  to  determine  the  extent  of 
nonconforming  products.  None  of  the  nonconforming  products  identified  in  the 
audit  were  reported  on  a  PQDR.  Based  on  the  statistical  sample,  we  estimated 
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that  less  than  10  percent  of  product  nonconformances  were  ever  properly 
recorded  and  processed  through  the  PQDR  system.  Apparently,  the  users  of 
products  either  did  not  identify  or  did  not  report  nonconforming  products. 

The  IG,  Air  Force  Materiel  Command,  Report  No.  PN  92-06,  "Report  of 
Process  Effectiveness  Review,  Product  Quality  Deficiency  Rq>orting," 
July  29,  1992,  reported  that  the  PQDR  Program  was  cumbnsome.  Based  on 
interviews,  no  more  than  10  to  IS  percent  of  all  possible  deficiencies  to  include 
nonconforming  products  were  reported  on  PQDRs.  The  report  recommended 
improvements  to  training,  procedural  guidance,  data  base  communications,  and' 
contracting.  Previous  audits  in  DLA  have  also  shown  a  need  for  training  in  the 
PQDR  Program.  During  the  audit,  we  confirmed  a  need  for  continuing  training 
in  the  Army  and  the  Navy  as  well.  The  DoD  Components  should  add  initiatives 
to  objective  23  for  proper  training  for  completing  PQDR  forms  and  segregating 
nonconforming  products  for  investigation. 

Government-Industry  Data  Exchange  Program.  The  Government- 
Industry  Data  Exchange  Program  (GIDEP)  collects  and  records  quality 
deficiency  data  and  enables  Government  and  contractor  organizations  to 
exchange  technical  information  applicable  to  Government  contracts  and 
equipment.  On  April  9,  1991,  the  Office  of  Federal  Procurement  Policy 
(OFPP),  Office  of  Management  and  Budget,  published  Policy  Letter  No.  91-3, 
"Reporting  Nonconforming  Products,”  requiring  Federal  agencies  to  participate 
in  the  failure  experience  data  interchange  portion  of  the  GIDEP  data  base. 

OFPP  Policy  Letter  No.  91-3  was  intended  to  establish  a  central  Federal  system 
for  exchanging  information  on  nonconforming  products  that  would  be  useful  to 
other  Fed^  agencies  and  that  would  protect  the  public  from  the  effect  of 
nonconforming  products.  The  information  exchange  would  help  diminate 
instances  in  which  Federal  agencies  or  their  contractors  acquire  products  and 
materiels  previously  identifi^  as  nonconforming  by  other  Federal  agencies. 
The  DoD  Components  participate  in  the  GIDEP  and  the  GIDEP  office  prepares 
reports  that  measure  toe  participation  of  toe  DoD  Components.  However, 
reporting  toe  nonconforming  products  to  toe  GIDEP  was  not  included  as  an 
initiative  in  toe  DoD  Component  implementing  action  plans.  The 
DoD  Components  should  include  toe  reporting  of  nonconforming  products  to 
GIDEP  as  required  by  OFPP  Letter  No.  91-3,  as  an  initiative  for  objective  23.  - 

DoD-wide  Deficiency  Reporting  System.  The  Joint  Logistics  Systems  Center 
is  managing  toe  development  of  the  DoD-wide  Deficiency  Reporting  System 
that  will  standardize  deficiency  reporting  into  a  single  computer  application. 
The  DoD-wide  Deficiency  Reporting  System  will  replace  toe  DoD  Components' 
duplicate  automated  information  systems.  Standardization  of  this  portion  of  toe 
DoD  corporate  logistics  process  will  result  in  cost  effectiveness  and  operational 
efficiency. 

The  Joint  Lo^stics  Systems  Center  has  worked  with  quality  assurance  and 
supply  operations  experts  from  toe  DoD  Components  to  model  toe  complaint 
processes  and  to  choose  an  appropriate  standard  automated  system  for  reporting 
and  recording  product  discrepancies.  The  DoD-wide  Deficiency  Reporting 
System  is  modeled  after  toe  Navy  System,  Deficiency  Reports  Log,  which  is 
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designed  to  process  PQDRs  and  i^rts  of  discrq)ancy  on  a  few  standard 
reporting  forms.  The  standard  system  was  scheduled  for  five  deployments  in 
1994  with  the  first  deployment  scheduled  for  February  1994.  The 
DoD  Components  did  not  include  the  DoD-wide  Deficiency  Rqjorting  System 
as  an  initiative  in  any  of  the  objectives  of  their  implementing  action  plans.  In 
addition,  initiatives  are  needed  to  reduce  the  number  of  forms  for  rqK)rting 
nonconformances  and  to  standardize  the  forms  and  the  use  of  the  forms.  The 
DoD  Components  should  establish  the  implementation  of  the  DoD-wide 
Deficiency  Reporting  System  as  an  initiative  under  objective  23. 

Independent  Quality  Assurance  Testing.  DoD  Directive  4140. 1-R,  "DoD 
Materiel  Management  Regulation,”  states  that  only  ^are  and  rq)air  parts  that 
fully  conform  to  contract  specifications  will  enter  the  DoD  supply  system.  DoD 
Directive  4140. 1-R  further  states  that  the  DoD  Components  will  implement  a 
program  for  identifying  spare  and  repair  parts  that  do  not  meet  contract 
specifications.  The  program  will  be  based  on  the  general  objectives  and 
procedures  contained  in  the  DoD  Action  Plan  and  will  provide  that  laboratory 
testing  will  be  used  as  a  tool  for  verification  that  secondary  items  procu^ 
conform  with  technical  specifications  before  item  acceptance.  The  testing 
program  should  emphasize  conformance  of  critical  items,  and  those  results 
shoidd  be  used  in  implementation  of  the  DoD-wide  PQDR  system. 
Objective  22,  to  enhance  the  use  of  DoD  and  independent  laboratory  test 
capabilities,  called  for  ^ansion  and  enhancement  of  laboratory  testing 
capability  and  parts  evaluation.  The  DoD  Components  already  own  most,  if  not 
all,  of  die  laboratory  testing  capability  that  is  needed  to  test  spare  and  repair 
parts. 


Random  and  Targeted  Testing  Strategies.  The  Military  Departments 
have  not  developed  strategies  for  cost-effective  quality  assurance  laboratory 
testing  programs.  Strategies  diat  feature  multi-puipose  testing,  such  as  random 
testing  withm  specific  F^end  supply  classes  and  targeted  testing  of  the  products 
supplied  by  problem  suppliers  were  needed.  Random  and  target  testing  would 
provide  current  intelligence  on  quality  problems. 

Problem  suppliers  are  usually  identified  through  validated  PQDRs. 
Unfortunately,  PQDRs  relate  primarily  to  historical  quality  problems  for 
products  procured  12  to  36  montiis  before  the  PQDR  was  initiated.  Laboratory 
testing  of  recently  delivered  products  verifies  Wstorical  quality  problems  and 
provides  current  scientific  information  for  targeting  quality  assurance  efforts  and 
for  applying  contract  clauses  that  reduce  the  risks  of  accq)ting  nonconforming 
products.  In  addition,  laboratory  testing  is  useful  for  validating  PQDRs  that 
deal  witii  nonconformances  in  complex  parts. 

The  Air  Force  Conformance  Verification  Program  tests  a  modest  number  of 
new  receipts  each  year.  The  Army  and  the  Navy  do  not  have  testing  programs 
to  implement  DoD  Directive  4140. 1-R.  DLA  has,  as  part  of  the  laboratory 
testing  program  described  in  DLA  Regulation  4105.20,  "Contractor 
Assessment-Product  Evaluation,"  e3q)anded  its  laboratory  testing  capability, 
adding  three  test  laboratories  to  support  the  Defense  Supply  Centers.  DLA  uses 
a  combination  of  its  own  laboratories.  Military  Department  laboratories,  and 
commercial  laboratories  that  specialize  in  specific  test  capabilities  to  support 
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U.S.  industries.  The  results  of  laboratory  testing  are  recorded  in  the  "System 
for  Analysis  of  Laboratory  Testing,"  data  base  for  future  reference  by 
procurement  contracting  officers.  The  Militaiy  Dq)artments  should  add  an 
objective  to  develop  strate^es  for  cost  effectively  employing  quality  assurance 
laboratory  testing  to  identity  product  lines  susceptible  to  nonconformances. 
Also,  DLA  should  update  its  action  plan  to  reflect  continuing  DLA  plans  to 
refine  the  testing  program. 

Identifying  Problem  Contractors.  The  Defense  Industrial  Supply 
Center  uses  its  testing  program  extensively  to  identity  and  target  problem 
contractors  for  intensive  quality  assurance  actions.  For  example,  grade  8  bolts 
and  class  3  fasteners  were  chronic  quality  problems  that  were  effectively 
addressed  in  the  Defense  Industrial  Supply  Center  Test  and  Evaluation  Masfe 
Plan.  IG,  DoD,  Report  No.  90-113  stated  that  an  estimated  27  percent  of 
1.1  biUion  parts  managed  by  the  Defense  Industrial  Supply  Center  were  found 
to  contain  major  nonconformances.  During  January  through  March  1993,  toe 
Defense  Industrial  Supply  Cento:  conducted  random  tests  of  372  new  industrial 
parts  that  showed  toe  nonconformance  rate  was  2.2  percent.  The  lower  rate  of 
products  identified  wito  major  nonconformances  demonstrates  that  laboratory 
testing  is  an  effective  quality  assurance  tool.  The  hfilitary  Departments  have 
not  developed  testing  programs  for  identifying  problem  contractors.  Die  DoD 
Components  should  add  toe  use  of  laboratory  testing  for  identitying  problem 
contractors  as  an  initiative  under  objective  22. 

Quality  Assurance  Test  Plans.  In  March  1993,  toe  DLA  Office  of  toe 
Executive  Director  of  Quality  Assurance  determined  toat  the  Defense  Supply 
Centers  were  developing  test  plans  differently.  The  test  plans  reviewed  durmg 
prior  IG,  DoD,  audits  showed  that  toe  test  plans  pr^ared  by  toe  Defense 
Industrial  Supply  Center  were  more  complete  than  those  prepared  by  the 
Defense  Electronics  Supply  Center,  hicomplete  test  plans  could  resitit  in 
understating  toe  nonconformances  at  Defense  Supply  Centers.  DLA  established 
policy  for  developing  test  plans;  however,  initiatives  are  needed  to  verify  toat 
test  plans  are  complete  and  that  all  critic^  characteristics  of  a  part  are  tested. 
The  DoD  Components  should  add  evaluation  of  toe  adequacy  of  test  plans  as  an 
initiative  to  objective  22. 


Recommendations,  Management  Comments,  and  Audit 
Response 


Terminology  in  Recommendations.  The  term  "update"  in  toe 
recommendations  for  corrective  action  recognizes  that  toe  DoD  Components 
have  an  existing,  ongoing  initiative  toat  is  not  adequately  described  m  toe 
DoD  Component’s  1990  implementing  action  plan.  The  term  "revise"  in  toe 
recommendations  for  corrective  action  is  used  when  a  DoD  Component  must 
add  an  initiative  or  objective  to  its  implementing  action  plan.  Our 
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recommendations  to  update  or  revise  specific  objectives  are  provided  as  a  ftame 
of  reference.  The  numbers  of  the  objectives  should  change  as  the  DoD 
Components  tailor  the  action  plans  to  their  needs. 

Revised  Recommendation.  Based  on  management  comments,  we  revised 
Recommendation  5.b.  by  eliminating  reference  to  In-plant  Quality  Evaluations. 

1.  We  recommend  that  the  Deputy  Under  Secretary  of  Defense  (Logistics): 

a.  Select  a  standard  DoD  vendor  rating  system  for  use  in  DoD. 

b.  F)stablish  regulations  for  implementing  United  States  Code, 
title  10,  section  2383,  to  require  that  contractors  supplying  critical  aircraft 
and  ship  parts  meet  appropriate  qualification  and  contractual  quality 
requirements. 

Deputy  Under  Secretary  of  Defense  (Logistics)  Comments.  The  Deputy 
Under  Secretary  stated  that  the  DoD  Past  Performance  Coordination  Council 
would  review  the  possible  establishment  of  a  standard  DoD  vendor  rating 
system  and  would  forward  its  recommendations  to  the  Under  Secretary  of 
Defense  for  Acquisition  and  Technology  by  July  199S.  In  regard  to 
10  U.S.C.  2383,  additional  action  by  DoD  was  not  appropriate  because  the 
legislation  will  likely  be  repealed. 

Audit  Response.  The  Deputy  Under  Secretary's  comments  on  the  standard 
vendor  rating  system  was  responsive;  however,  if  10  U.S.C.  2383  is  not 
repealed  before  June  13,  1994,  we  request  comments  on  the  final  report 
regarding  the  DoD  plan  to  implement  the  existing  law. 

2.  We  recommend  that  the  Assistant  Secretaries  of  the  Army  and  Navy 
(Research,  Development,  and  Acquisition);  the  Assistant  Secretary  of  the 
Air  Force  (Acquisition);  and  the  Director,  Defense  Logistics  Agency,  update 
their  implementing  action  plans  to  show  tte  current  or  planned  actions  to: 

a.  Maintain  technical  data  packages  and  make  them  available, 
adequate,  and  accurate  as  an  initiative  for  objective  2,  ensure  technical 
data  are  available,  adequate,  and  accurate  for  use  in  acquiring  quality 
parts. 

Army  Comments.  The  Army  nonconcurred,  stating  performance  specifications 
should  be  used  in  lieu  of  detail  specifications,  creating  less  need  for  maintaining 
technical  data  packages  by  eliminating  drawing  requiremrats.  The  Amw  also 
stated  that  there  are  initiatives  to  improve  the  acquisition  and  quality  of  data. 
Army  buying  caters  have  installed  a  digital  storage  and  retrieval  engineering 
system  and  developed  a  performance  specification  guide  to  help  foster 
commercial  buying  practices.  The  buying  centers  also  installed  a  technical  data 
configuration  management  system  to  control  changes  and  design  upgrades. 

Audit  Response.  We  do  not  consider  the  Army  comments  re^nsive.  While 
acquisition  reform  efforts  point  to  increasing  use  of  performance  specifications, 
technical  data  paclrages  ivill  still  be  needed  for  a  wide  assortment  of  military 
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specified  products.  The  requirement  to  maintain  adequate  and  accurate 
technical  ^ta  packages  is  include  in  DoD  5010. 12M,  "Procedures  for  the 
Acquisition  and  Management  of  Technical  Data."  Both  GAO  Report 
No.  GAO/NSIAD  92-23  and  IG,  DoD,  Report  No.  94-071  highlighted 
problems  with  technical  data  storage  and  transfer  that  require  improvement.  We 
request  that  the  Army  reconsider  updating  objective  2  as  recommended  and 
respond  in  comments  on  the  final  report. 

Navy,  Air  Force,  and  DLA  Comments.  Die  Navy  concurred  and  stated  that 
updat^  Navy  implementing  action  plans  described  programs  for  ensuring  tlmf 
technical  data  were  available,  adequate,  and  accurate  for  use  in  acquiring  quality 
parts.  Die  Air  Force  concurred  and  further  stated  that  Air  For(»  Materiel 
Command  Regulation  57-7  is  bein^  revised  to  identify  the  responsibilities  for 
maintenance  of  technical  information.  DLA  concurred  imd  stated  that  the 
revised  DLA  implementing  action  plan  included  additional  initiatives  to  improve 
the  quality  of  technical  data. 

Audit  Response.  We  request  the  Air  Force  to  provide  a  specific  date  for 
completing  the  corrective  action  in  its  comments  on  the  final  tepott. 

b.  Comply  with  the  requirements  of  Office  of  Federal  Procurement 
Policy  Letter  No.  91-3,  "Reporting  Nonconforming  Products,"  to 
participate  in  the  Government-Industry  Data  Exchange  Program  as  an 
initiative  for  objective  23,  improve  tiie  customer  complaint  syst^. 

Management  Comments.  The  Army  concurred  with  the  recommendation, 
stating  that  Army  Materiel  Command  major  subordinate  commands  regularly 
participate  in  the  GIDEP  program.  The  Navy  concurred  and  stated  that  the 
December  1993  updated  implementing  action  plan  described  actions  talmn  to 
participate  in  the  GIDEP  and  tp  automatically  use  the  GIDEP  reports  in  the 
Navy  Red,  Yellow,  Green  Vendbr  Rating  system.  The  Air  Force  concurred  and 
furtiier  described  tiheir  participation  in  the  GIDEP  for  the  past  30  years,  and 
described  cost  avoidances  of  $15.7  million  in  1992  firom  use  of  the  GIDEP 
reports.  DLA  stated  that  GIDEP  was  an  initiative  in  the  1990  implementing 
action  plan  and  GIDEP  was  institutionalized  within  the  DLA.  Implementation 
of  the  GIDEP  is  in  a  regulation,  a  manual,  and  in  training  courses  tiius 
additional  initiatives  were  unnecessary. 

c.  Support  the  development,  planned  deployment,  and 
implementation  of  the  DoD-wide  Defidency  Reporting  System  as  an 
initiative  for  objective  23,  improve  the  customer  complaint  system. 

Management  Comments.  The  Army  concurred,  stating  that  the  Materiel 
Command  Logistics  Support  Activity  and  Missile  Command  are  Army  lead 
activities  for  development  and  dQ)loyment  of  the  DoD-wide  Deficiency 
Reporting  System.  The  Navy  concurred  and  stated  that  it  fully  supports  and  is 
actively  participating  in  the  development  of  a  standard  deficiency  reporting 
system.  The  Navy  descriW  the  supporting  actions  in  the  December  1993 
updat^  implementing  action  plan.  Die  Air  Force  concurred  and  stated  that 
they  support  a  Joint  Logistics  Systems  Center  effort  to  implement  a  DoD-wide 
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Deficiency  Reporting  System.  DLA  concuiied  and  stated  that  the  revised 
implementing  action  plan  included  an  initiative  outlining  DLA  support  for  a 
DoD-wide  Deficiency  Reporting  System. 

d.  Reduce  the  number  of  forms  used  to  report  nonconfoimances, 
and  fitandardizn  the  forms  and  the  use  of  the  forms  as  initiatives  for 
objective  23,  improve  the  customer  complaint  system. 

Management  Comments.  The  Army  concurred,  stating  that  actions  are  being 
tjdcen  to  use  electronic  data  transfers  of  PQDRs,  reports  of  discrq)ancy,  and 
transportation  deficiency  r^rts.  The  Navy  concurred  and  stat^  Aat  the 
Decembm:  1993  updated  implementing  action  plan  addresses  standardmng  and 
reducing  the  number  of  forms  used  to  report  nonconformances  as  part  of  other 
initiatives  to  improve  the  PQDR  process.  The  Air  Force  concurred  and  stated 
that,  as  a  result  of  the  standard  DoD  Deficiency  R^rting  System,  the  numter 
of  forms  to  report  nonconforming  products  womd  be  reduced  and  the  remaining 
forms  would  be  standardized.  DLA  nonconcurred  and  stated  that,  as  a  direct 
result  of  electronic  systems,  the  use  of  paper  fornis  would  be  significant 
reduced  and  a  specific  item  in  the  implementing  action  plan  was  not  needed. 
Also,  with  the  initiatives  related  to  the  time  phased  implementation  of  the 
Deficiency  Reporting  System,  there  was  no  need  to  detail  a  related  initiative  in 
the  DLA  action  plan. 

Audit  Response.  The  DLA  response  does  not  reconcile  with  other  available 
information.  The  program  manager  for  the  DoD-wide  Deficiency  Reporting 
System  informed  us  that  gaining  acc^tance  from  DLA  on  the  use  of 
standm’dized  forms  was  one  of  the  unresolved  problems  facing  the  program. 
Accordingly,  we  request  that  DLA  reconsider  its  position  on  the 
recommendations  and  provide  comments  on  the  final  report. 

e.  Provide  the  training  needed  to  verify  that  the  Product  Quality 
Deficiency  Reports  ^ogram  is  used  effectively  as  an  initiative  for 
objective  23,  improve  the  customer  compl^t  system. 

Army  Comments.  The  Army  did  not  respond  to  this  recommendation. 

Audit  Response.  We  request  that  the  Army  provide  comments  on  the  final 
report. 

Navy,  Air  Force,  and  DLA  Comments.  The  Navy  concurred  and  stated  that 
the  December  1993  updated  implementing  action  plan  addresses  training 
improvemrats  and  other  actions  taken  to  improve  the  customer  complaint 
system.  The  Air  Force  concurred  and  stated  that  it  will  develop  automated 
training  pac^ges  that  provide  instructions  on  how  to  fill  out  PQDRs  by 
June  1994.  DLA  nonconcurred  but  stated  that  extensive  training  initiatives  were 
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previously  accomplished  and  that  training  has  already  been  scheduled  to 
coincide  with  deployment  of  the  DoD-wide  Deficiency  Reporting  System. 
Therefore,  additional  PQDR  initiatives  were  unnecessary. 

3.  We  recommend  that  the  Assistant  Secretaries  of  the  Army  and  Navy 
(Research,  Development,  and  Acquisition);  the  Assistant  Secretary  of  the 
Air  Force  (Acquisition);  and  the  Director,  Defense  Logistics  Agency,  revise 
their  implementing  action  plans  to: 

a.  Support  an  effort  to  identify  and  designate  one  i^stem  as  the 
standard  DoD  vendor  rating  system  as  part  of  an  additional  objective  to  the 
pre-contract  phase. 

Army,  Navy,  and  Air  Force  Comments.  The  Army  concurred  and  stated  that 
it  will  support  the  initiative  as  required  by  the  Under  Secretary  of  Defense  for 
Acquisition  and  Technology.  The  Navy  concurred  ^d  stated  mt  it  revised  the 
impiftmanting  action  plan  in  December  1993  to  include  initiatives  to  fully 
support  efforts  to  identify  and  designate  a  standard  vendor  rating  system.  The 
Navy  also  stated  that  the  Navy  Red,  Yellow,  Green  program  could  effectively 
perform  as  a  DoD-wide  system.  The  Air  Force  concurred  with  the  intent  of  the 
recommendation;  however,  it  questioned  whether  a  single  vendor  rating  system 
was  cost-effective  and  whether  a  single  vendor  rating  system  would  improve  the 
quality  of  spare  parts.  The  Air  Force  also  stated  any  action  on  this  should  be 
addressed  by  a  joint  service,  DLA,  and  Office  of  the  Secretary  of  Defense 
committee. 

DLA  Comments.  DLA  nonconcurred  and  stated  that  stand^dizing  the  vendor 
raring  systems  would  be  inappropriate  and  would  limit  flexibility.  The  adoption 
of  a  single  system  would  place  restrictions  on  activities  that  were  capable  of 
developing  more  effective  systems.  DLA  also  stated  that  standardization  of 
ratings  for  contractor  performance  was  a  valid  goal  and  that  goal  was  being 
pursued  by  tiie  Past  Penormance  Coordinating  Council. 

Audit  Response.  The  Deputy  Under  Secretary  of  Defense  for  Acquisition  and 
Technology  has  determined  that  the  Past  Performance  Coordinating  Council  will 
study  the  issue  of  adopting  a  standard  vendor  rating  system  and  will  provide  a 
recommendation  regarding  the  use  of  a  stand^d  vendor  rating  system.- 
Therefore,  we  accept  the  comments  of  the  DoD  Components  as  responsive  to 
the  recommendation. 

b.  Describe  the  actions  taken  to  comply  with  United  States  Code, 
title  10,  section  2383,  "Procurement  of  Critical  Aircraft  and  Ship  Parts,"  9S 
an  initiative  for  of  objective?,  ensure  all  suppliers  of  spare  and  repair 
parts  meet  specified  quality  and  technical  requirements. 

Army  and  Navy  Comments.  The  Army  concurred,  stating  that  it  has  had  an 
active  critical  safety  item  program  ance  1985.  Also,  the  Army  incorporated  the 
"Critical  Safety  Army  Program"  in  a  regulation  in  1991.  The  Navy  concurred 
and  stated  that  it  would  support  any  action  initiated  by  the  Office  of  the 
Secretary  of  Defense  but  noted  that  Congress  was  considering  legislation  to 
repeal  10  U.S.C.  2383. 
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Air  Force  and  DLA  Comments.  The  Air  Force  stated  that  compliance  with 
10  U.S.C.  2383  is  achieved  with  each  written  contract  b^use  contracts  include 
clauses  regarding  all  aspects  of  the  procurement.  The  Air  Force  also  stated  that 
section  2401  of  S1587  repeals  10  U.S.C.  2383.  DLA  nonconcurred  and  stated 
that  DoD  was  recommending  repeal  of  10  U.S.C.  2383;  therefore,  the 
recommendation  pertains  to  a  potentially  defunct  law.  Furthermore,  the 
Defense  Acquisition  Regulations  Council  has  determined  that  the  statute  was 
directed  at  program  managers  rather  than  contracting  officers,  essentially 
removing  DLA  from  involvement  in  the  issue. 

Audit  Response.  Repeal  of  10  U.S.C.  2383  was  recommended  in  several 
acquisition  reform  proposals  submitted  to  Congress.  If  10  U.S.C.  2383  is  not 
reined,  the  Air  Force  and  DLA  should  include  the  requirements  of 
10  U.S.C.  2383  in  their  implementing  action  plans.  If  10  U.S.C.  2383  is  not 
rq)^ed  by  June  13,  1994,  we  request  the  Air  Force  and  DLA  reconsider  their 
position  on  the  recommendations  and  provide  comments  on  the  final  rqx>rt. 

c.  Support  development  of  contractual  policy  proposals  to  obtain 
reimbursement  or  replacement  for  products  accepted  by  the  Government, 
but  later  found  to  contain  patent  defects,  as  an  initiative  for  objective  8, 
reject  or  require  corrections  of  nonconforming  supplies. 

Manajgement  Comments.  The  Army  concurred,  stating  that  contractors  are 
held  li^le  for  and  are  required  to  provide  restitution  to  the  Army  for  materiel 
acc^ted  and  later  found  to  be  defective.  The  Navy  concurred  and  stated  that  it 
revised  the  Navy  implementing  action  plan  in  December  1993  to  include 
examples  of  contractual  initiatives  talmn  to  hold  contractors  responsible  for 
patent  defects  after  accratance.  The  Navy  also  stated  that  it  would  support  any 
actions  taken  by  the  Office  of  the  Secretary  of  Defense  to  obtain  reimbursement 
or  replacement  for  patently  defective  products.  The  Air  Force  concurred  with 
the  intent  of  the  recommendation  and  offered  an  erq>ansion  to  the 
recommendation,  suggesting  that  the  Military  Departments  and  DLA  jointly 
examine  the  product  acceptance  process  and  emphasize  monitoring  and 
controlling  suppliers'  manufacturing  processes  before  foment  to  depots.  DLA 
concurred  and  stated  that  addition^  actions  were  needed  to  continue  initiatives 
begun  under  objective  8  of  the  DLA  implementing  action  plan.  The  additional 
irutiatives  were  included  as  identified  during  discussions  in  May  1993  with  the 
Director  of  Defense  Procurement  and  representatives  of  the  IG,  DoD,  to  devise 
a  means  for  holding  contractors  accountable  for  patent  nonconformances 
discovered  after  acceptance  for  certain  designated  product  lines. 

Audit  Response.  The  Army's  comments,  coupled  with  the  Army  plan  to 
update  and  reissue  an  implementing  action  plan  by  June  1,  1994,  are  responsive. 
We  believe  that  cooperative  initiatives  between  the  Milit^  Departments  and 
DLA  could  enhance  tiie  DoD  Component  implementing  action  plans.  However, 
we  ask  that  the  Air  Force  provide  a  completion  date  for  the  planned  actions  in 
response  to  the  final  report. 
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d.  Remove  nonconforming  products  identified  on  Product  Quality 
Deficiency  Reports  from  Defense  Supply  System  inventories;  notify 
contractors  when  their  nonconforming  products  are  discovered  and  providte 
copies  of  quality  deHciency  information  to  contractors  so  the  contractor  can 
correct  the  cause  of  the  quality  control  failure;  inform  contracting  officers 
so  they  can  attempt  to  recoup  the  value  of  the  nonconforming  products; 
and  document  the  quality  assurance  decisions  to  request  or  not  request 
laboratory  testing  needed  to  support  Product  Quality  Deficiency  Report  as 
initiatives  for  objective  23,  improve  the  customer  complaint  system. 

Management  Comments.  The  Army  concurred  with  the  intent  of  the 
recommendation  but  stated  that  no  changes  are  necessary  to  meet  the  intent  of 
the  recommendation.  The  Army  stated  ^t  procedures  were  in  place  to  prevent 
the  issuance  of  nonconforming  products  after  identification  on  PQDRs.  The 
Army  also  stated  that  item  managers  recoup  costs  from  defective  items  on  a 
case-by-case  basis  and  that  recoupment  ^ically  resulted  from  negotiations  with 
die  contractor.  The  Navy  concurred  and  stated  that  it  revised  the  implementing 
action  plan  in  December  1993  to  improve  the  customer  complaint  system  to 
include  initiatives  ensuring  that  defective  products  are  remove  from 
inventories,  that  supply  sources  are  fiilly  inform^  about  the  defective  products, 
that  contracting  officers  attempt  to  recoiq)  the  value  of  defective  products;  and 
that  appropriate  product  testing  is  conducted.  The  Air  Force  concurred  wiUi  the 
intent  of  the  recommendation  but  stated  that  the  proposed  actions  were  too 
specific  to  be  implemented  as  written.  DLA  nonconcmred  and  stated  that  DLA 
had  previously  included  all  of  the  recommendation  areas  in  their  quality 
assurance  manual  for  the  Defense  Supply  Centers.  In  addition,  management 
reviews  have  confirmed  that  the  revis^  procedures  have  been  incorporated  in 
the  Defense  General  Supply  Center  processes. 

Audit  Response.  We  believe  the  spedficity  of  the  recommendations  will  be 
helpful  to  die  drafters  of  Air  Force  initiatives  for  complete  actions  on  PQDRs. 
hi  addition,  we  request  that  Air  Force  reconsider  its  position  on  the 
recommendations  and  provide  comments  on  the  final  report. 

e.  Develop  strategies  for  cost  effectively  targeting  quality  assurance 
laboratory  testing  to  identify  susceptible  product  IMes  and  problem 
contractors,  and  to  randomly  test  the  products  supplied  by  problem 
suppliers  at  every  national  inventory  control  point  as  an  added  objective  for 
the  feedback  intelligence  phase. 

Army  Comments.  The  Army  partially  concurred,  agreeing  to  use  quality 
assurance  laboratory  testing  on  a  limited  basis.  However,  end-of-line  insprotion 
and  defect  detection  should  be  replaced  with  statistical  process  controls  in  the 
production  process  resulting  in  defect  prevention  and  control  of  processes. 

Audit  Response.  We  agree  that  the  use  of  statistical  process  controls  can  be 
used  to  prevent  the  occiirrence  of  defects;  however,  the  point  of  the 
recommendations  is  for  the  Army  to  tabs  the  initiative  to  determine 
effectiveness  of  DoD  acquisition  system  in  supporting  Army  field  units  with 
conforming  spare  parts.  We  request  the  Army  to  reconsider  its  position  on  the 
recommendation  and  provide  comments  on  the  final  report. 
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Navy,  Air  Force,  and  DLA  Comments.  The  Navy  concurred  and  stated  that  it 
revis^  the  implementing  action  plan  in  December  1993  to  show  that  the  Navy 
requires  100  percent  testing  of  all  Level  I  subsafe,  nuclear,  safety,  and  safety- 
of-flight  products.  The  Navy  is  attempting  to  increase  other  quality  assurance 
testing  programs  and  to  participate  with  the  Air  Force  and  DLA  in  their 
laboratory  testing  programs  and  to  use  the  results  of  those  programs  to  further 
identify  problem  suppliers.  The  Air  Force  concurred  wiA  me  intent  of  the 
recommendation  but  stated  that  enhancement  of  inspections  of  processes  at  the 
suppliers'  plmits  would  be  a  better  expenditure  of  funds.  Additionally,  the 
Air  Force  suggested  the  recommendation  should  read,  "Subject  to  the 
availability  of  funds.  .  DLA  stated  that  they  had  complete  numerous 
initiatives  associated  with  making  laboratory  testing  an  integral  part  of  the  DLA 
quality  assurance  effort  and  that  staff  assistance  visits  were  verifying  the 
effecdweness  of  the  laboratory  testing  programs  at  the  Defense  Supply  Centers. 

Audit  Response.  We  agree  that  implementing  action  plans  are  realistically 
constrained  to  current  resources.  However,  we  believe  that  both  pre-acceptance 
and  post-acceptance  laboratory  testing  is  important  in  today's  qukify  assurance 
environment.  We  accept  the  Air  Force  response.  DLA  has  made  commendable 
progress  toward  establishing  an  effective  l^oratory  testing  program  that  can  be 
used  to  evaluate  the  effectiveness  of  the  quality  assurance  effort  in  DLA.  DLA 
has  established  laboratories  to  support  the  Defense  Supply  Centers  and  has 
programs  to  enhance  the  effectiveness  of  the  testing  operations.  We  accept  the 
DLA  response. 

f.  Evaluate  the  adequacy  of  quality  assurance  laboratory  test  plans 
as  an  initiative  for  objective  22,  enhance  the  use  of  DoD  and  independent 
laboratory  test  capabilities. 

Army  Comments.  The  Army  partially  concurred  with  quality  assurance 
laboratory  testing  on  a  limited  basis.  However,  end-of-line  inspection  and 
defect  detection  should  be  rq)laced  witii  statistical  process  controls  in  the 
production  process  resulting  in  defect  prevention  and  control  of  processes. 

Audit  Remonse.  The  point  of  the  recommendations  is  for  the  Army  to  take  the 
initiative  in  determining  the  effectiveness  of  the  Defense  acquisition  system  in 
supporting  Army  field  units  with  conforming  ^are  parts.  We  request  that  the 
Army  reconsider  its  comments  in  response  on  the  final  report. 

Navy,  Air  Force,  and  DLA  Comments.  The  Navy  concurred  and  stated  that  it 
revised  the  implementing  action  plan  in  December  1993  to  show  that  it  evaluates 
the  adequacy  of  quality  assurance  test  plans.  The  Navy  also  stated  that  the 
Navy  Supply  organizations  are  conducting  meetings  to  determine  how  to 
proceed  with  the  laboratory  testing  effort.  The  Air  Force  concurred  with  the 
intent  of  the  recommendation  but  stated  that,  because  of  the  e;q)ense  of 
laboratory  testing  and  decreasing  budgets,  the  recommendation  should  contain 
the  words,  "subject  to  the  availatoty  of  funds."  DLA  nonconcurred  and  stated 
that  DLA  quality  assurance  laboratory  test  plans  are  adequate  to  determine 
conformance.  DLA  has  conducted  a  workshop  to  verify  that  the  Defense 
Supply  Center  methods  for  developing  test  plans  were  adequate.  DLA  has 
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conducted  reviews  in  the  past  and  plans  to  conduct  Quality  Management 
Reviews  at  the  Defense  Supply  Centers  to  continually  evaluate  and  improve  the 
adequacy  of  laboratory  test  plans. 

Audit  Response.  We  understand  the  Air  Force's  need  to  prioritize.  However, 
we  believe  tiiat  the  Air  Force  should  explain  how  it  will  evaluate  the  adeqi^y 
of  test  plans  when  fiinds  are  available.  We  request  the  Air  Force  to  reconsider 
its  position  on  the  recommendations  and  provide  comments  on  the  final  report. 

4.  We  recommend  that  the  Assistant  Secretaries  of  the  Army  and  Navy 
(Research,  Development,  and  Acquisition)  and  the  Assistant  Secretary  of 
the  Air  Force  (Acquisition)  revise  the  Military  Department  implementing 
action  plans  by  adding  an  initiative  to  test  product  lines  stored  in  depot 
inventories  suspected  of  containing  nonconforming  products  as  part  of 
objective  18,  identify  and  purge  nonconforming  materiel  from  wholesale 
level  inventory. 

Army  Comments.  The  Army  concurred  with  the  intent  of  the 
recommendation;  however,  changes  were  not  necessa^  because  current  Army 
initiatives  are  already  in  place  to  purge  nonconforming  products  from  dqwt 
inventories. 

Audit  Response.  We  do  not  find  the  Army  comments  responsive.  The 
Military  Departments  are  not  maMng  use  of  the  available  information  regarding 
suscq)able  product  lines  and  poor  performing  contractors  to  identify  products 
suspected  of  containing  nonconformmg  products.  The  recommended  revision  to 
objective  18  would  provide  an  initiative  to  proactively  identify  and  purge 
nonconforming  items  from  inventories,  instead  of  reacting  to  deficiency  reports, 
safety  alerts,  and  other  information  that  sometimes  comes  back  from  users  oitiy 
{^r  equipment  has  failed  under  use.  We  request  that  the  Army  reconsider  its 
position  on  the  recommendations  and  provide  comments  on  the  final  report. 

Navy,  and  Air  Force  Comments.  The  Navy  concurred  and  stated  that  the 
December  1993  implementing  action  plan  was  revised  to  include  a  program  to 
test  diesel  engine  spare  and  r^air  parts.  The  Navy  plans  to  expand  its 
laboratory  testing  program  to  include  spare  parts  for  gas  turbine  engines, 
pumps,  and  air  conditioning  units.  The  Air  Force  concurred  with  the  intent  of 
the  recommendation  but  stated  that  the  recommendation  should  be  deleted 
because  it  duplicated  an  existing  initiative  in  tiie  Air  Force  implementing  action 
plan.  The  Air  Force  has  initiatives  in  the  1990  implementing  action  plan  to 
perform  laboratory  testing  of  critical  items  and  products  suspended  because  of 
GIDEP  and  PQDR  identification. 

5.  We  recommend  that  the  Director,  Defense  Logistics  Agency,  revise  the 
Defense  Logistics  Agency  Action  Plan  to  add: 

a.  An  objective  to  develop  the  Contractor  Profde  System  in  the  pre¬ 
contract  phase. 
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DLA  Comments.  DLA  concurred  and  stated  that  rewritten  initiatives  were 
included  in  the  revised  DLA  implementing  action  plan.  Dq)loyment  of  the 
contractor  profile  system  is  scheduled  for  May  1994. 

b.  An  objective  to  measure  the  edent  to  which  each  DoD 
contractors'  quality  control  processes  are  reviewed  and  validated. 

DLA  Comments.  DLA  nonconcurred  and  stated  that  Process-Oriented 
Contract  Administration  Services  is  replacing  IQUE  to  increase  communication 
among  tiie  contract  administration  participants. 

Audit  Response.  Process-Oriented  Contract  Administration  Services  is  not 
appropriate  for  all  Defimse  contractors,  and  some  contractors  will  not  agree  to 
p^cipate  in  a  teaming  agreement.  Therefore,  we  have  revis^  the 

recommendation  to  provide  an  objective  to  measure  the  extent  to  which  each 
Defense  contractors'  processes  are  verified.  Accordingly,  we  request  that  DLA 
comment  on  the  revised  recommendation  in  its  comments  on  the  ^al  report. 

c.  An  objective  to  implement  the  commercial  quality  standards  that 

are  d^acribed  in  the  International  Organization  for  Standardization 
^O)  9000  series  and  equivalent  ^^erican  National  Standards 

Institute/American  Society  for  Quality  Control  (ANSI/ASQC  Q90)  quality 
system  series. 

DLA  Comments.  DLA  nonconcuned  and  stated  that  it  was  prohibited  from 
implementing  the  ISO  9000  series  and  equivalent  ANSI/ASQC  Q90  on  Defense 
Supply  Center  contracts.  DLA  stated  that  it  could  not  act  on  this 

recommendation  until  the  Office  of  the  Secretary  of  Defense  rescinds  the 

prohibition  on  using  ISO  as  a  substitute  for  the  MIL-I-4S208A  Inspection 
System  Requirements.  DLA  also  stated  that  ISO  9000  focuses  on  the  supplier's 
documented  sntem  rather  than  on  the  inherent  quality  of  the  system's  products. 
As  such,  implementation  of  ISO  9000  will  have  minimal  impact  on  the  quality 
of  spare  and  repair  parts  in  the  defense  industry. 

Audit  Response.  The  Under  Secretary  of  Defense  for  Acquisition  and 
Technology  authorized  the  use  of  ISO  9(XX)  series  standards  for  MIL-I-45208A, 
"Inspection  System  Requirements,"  in  a  memorandum  for  the  Secretaries  of  tiie 
Military  Departments  and  the  Directors  of  Defense  Agencies,  "Use  of 
Commercial  Quality  System  Standards  in  the  Deparonent  of  Defense  (DoD)," 
February  14,  1994.  DLA  may  now  use  ISO  9000  in  its  contracts  and  it  will 
have  additional  responsibilities  to  determine  the  extent  of  its  quality  assurance 
effort  for  ISO  9000  contracts.  Therefore,  we  request  that  DLA  reconsider  its 
position  on  the  recommendations  and  provide  comments  on  the  final  rqxirt. 

d.  An  initiative  to  develop  training  for  Defense  Contract 
Management  Command  quality  assurance  representatives  on  how  to 
evaluate  the  E»0  9000  and  ANSI/ASQC  Q90  commercial  quality  systems 
under  objective  12,  and  update  in-plant  Government  quality  assurwce 
procedures  to  provide  Government  quality  assurance  representatives 
flexibility  to  tailor  oversight. 
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DLA  Comments.  DLA  nonconcuired  and  stated  that  training  applicable  to 
ISO  9000  has  no  impact  on  the  DLA  implementing  action  plan.  DLA  also  said 
that  the  use  of  international  quality  standards  was  limits  to  at^uisitions  to 
which  MIL-Q-9858A,  "Quality  Program  Requirements,"  were  applied. 

Audit  Response.  The  DLA  implementing  action  plan  needs  to  show  DLA 
initiatives  to  inform  and  train  its  workforce  regarding  ISO  9000.  The  Under 
Secretary  of  Defense  for  Acquisition  and  Technology  authorized  the  use  of 
ISO  900i0  for  all  spare  parts  contracts  involving  the  higher  levels  of  quality. 
Therefore,  we  request  that  DLA  reconsider  its  position  on  the  recommendations' 
and  provide  comments  to  the  final  report. 

e.  An  initiative  to  measure  the  numbers  of  waivers  and  deviations 
and  the  number  of  Material  Review  Board  actions  that  are  approved  and 
include  that  information  in  the  Quality  Effectiveness  Sensing  Technique 
under  objective  10,  reduce  contractor  materiel  review  board  actions  and 
requests  for  waivers  or  deviations. 

DLA  Comments.  DLA  nonconcurred  and  stated  that  e3q)etience  has  shown  that 
summaries  of  waivers,  deviations,  and  Material  Review  Board  actions  are  just 
not  good  measures.  Data  on  waivers,  deviations,  and  Material  Review  Board 
action  are  collected  for  and  stored  in  the  Qu^^  Assurance  Management 
Information  System,  and  extracted  for  the  Quality  Effectiveness  Sensing 
Technique.  DLA  stated  that  it  was  reconsidering  the  viability  of  the  Quality 
Effectiveness  Sensing  Technique  and  had  decided  to  rely  on  the  process-oriented 
approach,  because  it  more  completdLy,  directly,  and  efficiently  pursues  our  goal 
of  reducing  nonconforming  material.  The  Process-Onented  Contract 
Administration  Services  program  focuses  individually  on  the  contractor 
processes  that  support  contract  performance.  Performance  data  are  used  locally, 
in  the  plant. 

Audit  Response.  The  DLA  comments  are  nonresponsive.  DLA  has  ^nt 
years  developing  and  refining  the  Quality  Effectiveness  Sensing  Technique. 
DLA  nqmrted  that  the  Quality  Effectiveness  Sensing  Technique  m  model  was 
tested  in  November  1991.  At  that  time,  experts  from  the  Defense  Contract 
Management  Command  and  DLA  Headquarters  found  that  it  was  reliable. 
Without  additional  information  on  the  deficiencies  of  the  Quality  Effectiveness 
Sensing  Technique,  we  can  only  question  the  decision  to  abandon  such  a 
potentially  powerful  management  tool  in  favor  of  the  Process-Oriented  Contract 
Administration  Services  program  that  does  not  apply  to  all  DoD  contractors. 
Therefore,  we  request  that  DLA  reconsider  its  position  on  the  recommendation 
and  provide  comments  on  the  final  report. 

f.  An  objective  to  verify  that  inspection  procedures  for  repackaged 
products  are  applied  so  that  damaged  products  are  not  sent  out  and  that  all 
necessary  information  is  included  on  &e  package  label  as  part  of  the  depot 
(supply  maiuigement)  phase. 
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DLA  Comments.  DLA  nonconcurred  and  stated  that  the  problems  were  with 
the  Red  River  Army  Depot  and  that  after  Red  River  became  a  DLA  depot  the 
problems  were  corrected.  DLA  also  stated  that  it  has  a  program  for  inspecting 
items  for  proper  packaging  and  marking  before  shipment  to  customers. 

Audit  Response.  DLA  has  an  overall  performance  measure  in  the  1993  DLA 
implementing  action  plan  to  measure  the  valid  customer  complaints  against 
distribution  d^ts.  We  accept  DLA's  action  as  responsive  to  the 
recommendation. 


Response  Requirement  For  Each  Recommendation 


Responses  to  the  final  lepoit  are  required  from  the  addressees  shown  for  the 
items  indicated  in  the  table  below. 


For  Recommendation  Shown  Response  Should  Cover 
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Concur/ 

Nonconcur 

Proposed 

Action 

Completion 

Date 

Dq)uty  Under  Secretary 
Defense  (Logistics) 

l.b. 

l.b 

l.b. 

Army 

2. a.  2.e. 

3. e.,  3.f., 

4. 

2. a. ,  2.e. , 

3. e.,  3.f., 

4. 

2. a.,  2.e., 

3. e. ,  3.f. , 

4. 

Air  Force 

3.b.,  3.d., 
3.f., 

3.b.,  3.d., 
3.f., 

2. a.,  2.d., 

3. b. ,  3.C. , 
3.d.,  3.f. 

DLA 

2. d.  2.e., 

3. b.,  S.b., 

3.C. ,  3.d. , 

5.e. 

2. d.,  2.e., 

3. b. ,  S.b., 
S.c. ,  S.d. , 
5.e. 

2.d.,  3.b., 
S.b.,  S.c. , 
5.d.,  S.e. , 

Management  Comments  and  Audit  Response  on  the  Finding 


DLA  Comments.  DLA  nonconcurred  with  the  Finding  B  and  stated  that  DLA 
had  an  automated  capability  to  add,  delete,  and  revise  objectives.  Printouts  of 
periodic  updates  showed  that  DLA  revised  objectives,  initiatives,  performance 
measures,  and  milestones  in  each  area  and  that  the  revisions  reflected  curr^t 
quality  program  objectives  and  initiatives.  The  DLA  Deputy  Director  used  this 
system  to  review  and  monitor  actions.  Periodic  briefings  were  presented  to  the 
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DLA  Director  and  Deputy  Director.  Documents  from  the  above  actions  show 
that  DLA  did  use  the  DLA  Action  Plan  as  a  managemrat  tool  for  continuously 
improving  the  quality  of  spare  and  rq)air  parts. 

Audit  Response.  As  previously  described  in  our  re^nse  to  DLA  commits 
on  Finding  A,  the  printouts  of  the  DLA  implemen^g  action  p^  show  that 
relatively  little  change  was  made  to  the  objectives  and  initiatives  from 
January  1,  1992  through  May  30,  1993.  For  at  least  17  months,  DLA  did  not 
use  die  DLA  implementing  action  plan  as  a  management  tool  for  continuously 
improving  tiie  quality  of  spare  and  tepm  parts. 


Management  Comments  and  Audit  Response  on  Appendix  C 


DLA  Comments.  DLA  stated  that  the  evaluative  criteria  used  for  Appendix  C 
was  not  clear  for  determining  initiative  and  objective  completion,  h^y  of  the 
action  pl^  objectives  were  meshed  into  the  DLA  key  business  processes  and 
win  always  require  management  attention.  DLA  stated  that  the  action  plan 
objectives  that  wiU  always  require  management  attention  should  ^  part  of  an 
organization's  strategic  and  operational  plans  and  should  not  be  included  in  a 
"Quality  Assurance”  Action  Pkui.  An  action  plan  ought  to  mean  that  immediate 
action  is  needal  to  resolve  known  or  antidpated  problems.  Specifically,  DLA 
did  not  understand  why  objective  3,  assign  parts  requiring  intensive  technical 
management  oversight  to  the  proper  item  manager;  objective?,  ensure  all 
suppliers  of  spare  and  repair  parts  meet  specific  quality  and  technical 
requirements;  and  objective  22,  enhance  the  use  of  DoD  and  independent 
laboratory  test  capabilities,  were  not  considered  complete.  DLA  considered  the 
urgent  actions  under  the  objectives  3, 7,  and  22  to  be  complete. 

Audit  Response.  The  DLA  implementing  action  plan  should  be  a  compendium 
of  all  significant  objectives  with  near-term  and  long-range  initiatives.  In  the 
absence  of  a  separate  internal  quality  organization  within  DLA,  the  DLA  Action 
Plan  represents  the  most  sign^cant  qu^ty  statement  for  DLA  for  continuous 
long-range  improvement.  The  DLA  action  plan  for  continuous  improvement 
should  openly  identify  the  chronic  problems  ^t  affect  quality  and  th^en  should 
fitily  describe  the  initiatives  for  boA  short-range  and  long-range  solutions.  The 
accountability  for  each  initiative  should  be  established  through  definite  wd 
quantifiable  performance  measures  and  realistic  milestones.  Ihe  DLA  Action 
Plan  should  openly  identify  DLA's  chronic  problems  assoc^ted  with  technical 
data;  poor  pefforming  suppliers;  Government  in-plant  quality  assurance;  dq)ot 
receiving,  storage  and  distribution;  and  feedback  programs  to  include  laboratory 
testing.  An  action  plan  for  continuous  improvement  ^ould  include  initiatives 
that  go  beyond  issuing  regulations,  policy  memorandums,  and  handbooks.  The 
additional  initiatives  ^ould  verify  implementation  of  the  policy. 
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Part  III  -  Additional  Information 


Appendix  A.  Summary  of  Prior  Audits  and 

Other  Reviews 


General  Accounting  Office 


Report  No.  GAO/NSIAD-92-23,  (OSD  Case  No.  8891)  "Defense  Procurement, 
Improvement  Needed  in  Technics  Data  Management,"  February  1992.  The 
report  stated  that  data  quality  problems  continued  to  inhibit  contractors  from 
competing  for  Government  work  or  completing  the  work  after  a  contract  was 
awarded.  The  report  recommended  that  procurement  offices  and  data  r^sitory 
sites  include  in  each  solicitation  the  telephone  numbers  of  the  persons  who  can 
solve  technical  data  problems.  DoD  Management  concurred  with  the  finding 
and  the  recommendation  and  is  initiating  action  to  establish  the  point  of  contact 
in  DoD  procurement  solicitations. 


Inspector  General,  DoD 


Report  No.  94-071,  "Report  on  the  Transfer  of  the  Management  of  Consumable 
Items  to  the  Defense  Logistics  Agency,"  March  31,  1994.  The  report  stated 
that  the  Services'  inventory  managers  did  not  transfer  essential  logistics 
management  data  needed  to  complete  the  technical  data  packages  in  a  timely 
manner.  The  data  were  not  transferred  because  controls  were  not  established  to 
ensure  that  transferred  data  were  timely,  complete,  and  accurate.  The  report 
recommended  that  DLA  establish  a  tracking  system  for  technical  data  and 
reconcile  the  number  of  technical  data  pac&ges  that  are  overdue  from  the 
Services.  DLA  concurred  with  the  recommendation. 

Report  No.  93-091,  "Management  of  the  DoD  Action  Plan  for  Improving  the 
Quality  of  Spare  and  Repair  Parts,"  April  28,  1993.  The  report  stated  that 
Office  of  the  Searetary  of  Defense  ofticials  did  not  manage  the  DoD  Action 
Plan.  The  Under  Secretary  of  Defense  for  Acquisition  and  Technology  did  not 
assign  managemrat  of  the  DoD  Action  Plan  to  the  appropriate  action  office,  did 
not  monitor  implementation  of  the  DoD  Action  Plan,  and  did  not  change  the 
DoD  Action  Plmi  as  needed.  The  report  recommended  that  the  Under  Secretmy 
of  Defense  for  Acquisition  and  Technology  revise  and  reissue  the  DoD  Action 
Plan  every  2  years,  establish  a  feedback  system  to  monitor  DoD  Component 
implementation  of  the  DoD  Action  Plan,  assign  management  responsibility  to 
the  appropriate  office  and  update  the  March  1990  version  of  the  DoD  Action 
Plan.  The  Principal  Deputy  Assistant  Secretary  of  Defense  (Production  and 
Logistics)  concurred  with  the  intent  of  the  recommendations.  We  agreed  to 
accept  revisions  to  DoD  Directive  4140. 1-R,  "DoD  Material  Management 
Regulation,"  as  satisfactory  management  action  on  the  recommendation. 
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Rq)ort  No.  93-066,  "Recoupments  for  Quality  Defects,"  March  10,  1993.  The 
report  stated  that  Defense  Supply  Centers  did  not  perform  complete  quality 
assurance  investigations  needed  to  obtain  recoupments  for  defective  electronic 
products.  The  report  recommended  revising  DLA  Manual  4155.2,  "Quality 
Assurance  Program  Manual  for  Defense  Supply  Centers  and  Defense  Industrie 
Plant  Equipment  Centers,"  to  verity  that  complete  quality  assurance 
investigations  are  performed.  In  addition,  the  report  recommended  screening 
inventories  suppli^  under  21  specific  contracts  and  requesting  replacement  of 
products  with  major  nonconformances  from  Federal  Prison  hidustries, 
Incorporated.  The  DLA  agreed  to  revise  DLA  Regulation  4155.24,  "PQDR 
Program."  The  DLA  also  agreed  to  screen  sjpecific  inventories  and  to  request 
repl^ments  from  Federal  Prison  Industries,  Incorporated.  The  Army 
generally  concurred  with  the  iqiort’s  findings  and  other  recommendations. 

Report  No.  92-099,  "Quality  Assurance  Actions  ^suiting  from  Electronic 
Component  Screening,"  June  8,  1992.  The  report  desmbed  problems  with  the 
collection,  distribution,  and  use  of  quality  deficiency  information  in  DoD.  The 
report  also  stated  that  testing  of  dectronic  components  was  inadequate  to 
identity  and  follow  up  on  contractors  who  provided  defective  electronic 
components.  In  addinon,  DoD  did  not  have  effective  remedies  to  obtain 
reimbursement  or  replacement  for  major  and  critical  products  with  patent 
defects.  The  Army,  Navy,  Air  Force,  and  DLA  generally  concurred  with  the 
r^rt's  findings  and  recommendations.  As  a  result  of  the  recommendation,  the 
Director  of  Defense  Procurement  requested  and  DLA  officials  agreed  to  identify 
problem  products  and  product  lines/suppliers  and  to  describe  ongoing,  planned, 
or  proposed  initiatives  to  address  nonconforming  products  and  possible  policy 
propo^s  covering  recoupments  for  products  with  major  nonconformances. 

Report  No.  90-113,  "Nonconforming  Products  Procured  by  the  Defense 
Industrial  Supply  Center,"  September  27,  1990.  The  report  stated  that,  of 
1.3  billion  parts,  27  percent  (valued  at  about  $171  million)  were  major 
nonconforming  products.  The  audit  recommendations  involved  standardizmg 
definitions  for  nonconformances,  improving  new  receipt  quality  assurance 
testing,  establishing  criticality  of  spare  parts,  and  improving  the  quality 
assurance  feedback  system.  The  DLA  implementation  of  &e  DoD  Action  Plan 
satisfied  the  intent  of  the  recommendations. 

Lispection  Report  No.  90-INS- 17,  "DoD  Quality  Assurance  Program," 
August  29,  1990.  The  report  stated  that  administrative  contracting  officers  were 
not  seeldng  consideration  for  excessive  amounts  of  minor  nonconforming 
material.  The  report  recommended  that  DLA  establish  and  implement  policy 
that  ensured  consideration  would  be  sought  for  each  contract  containing 
nonconforming  material.  DLA  nonconcurred  with  the  recommendation,  stating 
tiiat  DLA  policy  was  consistent  with  the  Federal  Acquisition  Re|ulation.  DLA 
and  IG,  DoD,  agreed  that  the  proposed  actions  in  the  DLA  Acuon  Plan  would 
provide  the  needed  improvements  to  the  quality  of  products. 

Report  No.  89-065,  "Nonconforming  Products  in  the  Defense  Supply  System  at 
Warner  Robins  Air  Logistics  Center,"  April  10,  1989.  The  report  stated  that 
$14.4  million  of  $110  million  of  spare  parts  contained  major  nonconformances. 
Additionally,  the  Air  Force  PQDR  System  did  not  provide  an  adequate  data 
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feedback  system  or  reflect  the  quality  of  spare  parts  provided  to  field  activities. 
The  report  recommended  that  the  Assistant  Secretary  of  Defense  (Production 
and  Logistics)  issue  a  joint-Service  regulation  to  reduce  nonconforming 
products.  The  report  also  recommended  that  the  Air  Force  establish  quality 
assurance  testing  programs  and  provide  PQDRs  to  contract  administration 
offices  for  investigation.  The  Assistant  Secretary  of  Defense  (Production  and 
Logistics)  and  Air  Force  management  concurred  with  the  recommendations.  As 
a  result  of  the  report,  the  DoD  Action  Plan  was  formulated  and  issued  in 
March  1990  and  the  Air  Force  established  a  Conformance  Verification  Testing 
Program. 


Air  Force 


IG,  Air  Force  Materiel  Command,  Rq)ort  No.  PN  92-06,  "Report  of  Process 
Effectiveness  Review,  Product  Qu^ty  Deficiency  Reporting,"  July  29, 
1992,  The  report  stated  that  the  PQDR  Program  was  cumb^some  and  only 
15  to  20  percent  of  quality  defects  were  rq)orted  on  PQDRs.  The  report 
recommended  improvements  for  training,  procedural  guidance,  database 
communications,  and  contracting.  The  report  did  not  require  a  response  from 
Air  Force  management. 
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Improving  the  Quality  of  Spare 
and  Repair  Parts 

The  DoD  Action  Plan  issued  on  March  2,  1990,  contains  the  following. 
26  objectives  presented  in  S  phases:  pre-contract,  contract,  contract 

administration,  depot  (supply  management),  and  feedback  intelligence.  The 
five  phases  recognize  the  need  for  continuous  management  throughout  the 
acquisition  process.  The  objectives  are  not  prioritized. 


Pre-Contract  Phase 


The  primary  pre-contract  phase  objectives  are  to  standardize  definitions  for 
nonconformances;  make  technical  data  available,  adequate,  and  accurate,  using 
quaU^  in  the  source  selection  process;  and  apply  available  remedies  to  protect 
DoD  interests  in  support  of  sound  contracting  decision-making. 

1.  Standardize  the  DoD  definitions  and  terminology  for  a  nonconformance. 

2.  Ensure  technical  data  are  available,  adequate,  and  accurate  for  use  in 
acquiring  quality  parts. 

3.  Assign  parts  requiring  intensive  technical  management  oversight  to  the 
proper  item  manager. 

4.  Encourage  the  use  of  quality  factors  in  the  source  selection  process  for 
spare  and  repair  parts. 

5.  Share  the  desire  and  incentive  for  sustained  high  quality  with  the  contractor 
through  long-term  competitive  buyer/seller  contract  relationships  for  families  of 
items. 

6.  Apply  the  remedies  available  to  the  Government  to  identify  and  protect 
itself  ftom  chronically  poor  suppliers. 


Contract  Phase 

The  prima^  contract  phase  objectives  are  to  ensure  that  spare  parts  suppliers 
meet  quali^  requirements;  nonconforming  products  are  either  reject^  or 
correct^,  and  contractors  are  provided  incentives  to  reduce  risks  associated 
with  |>rocuring,  accepting,  and  distributing  products  later  identified  as 
containing  patent  defects. 
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7.  Ensure  all  suppliers  of  spare  and  repair  parts  meet  specified  quality  and 
technical  requirements. 

8.  Reject  or  require  corrections  of  nonconforming  supplies. 

9.  Establish  incentives  for  contractors  to  continuously  reduce  production 
process  variability. 


Contract  Administration  Phase 

The  primary  contract  administration  phase  objectives  are  to  reduce  the  number 
of  waivers,  deviations,  and  contractor  Material  Review  Boards;  make 
Government  quality  assurance  more  flexible;  encourage  the  use  of  analytical 
methods  to  control  production  processes;  recognize  qimty  contractors;  enforce 
prime  contractor  responsibility  for  subcontractor  controls;  and  measure  the 
effectiveness  of  Government  quality  assurance  to  reduce  the  chances  that 
DoD  contractors  will  tender  defective  products  to  the  Government  for 
acceptance. 

10.  Reduce  contractor  Materiel  Review  Board  actions  and  requests  for  waivers 
or  deviations. 

11.  Require/encourage  contractors  to  use  analytical  methods  to  control 
production  processes. 

12.  Update  in-plant  Government  quality  assurance  procedmes  to  provide 
Government  quality  assurance  representatives  flexibility  to  tailor  oversight. 

13.  Enforce  prime  contractor  responsibility  over  subcontractors. 

14.  Measure  effectiveness  of  in-plant  Government  contract  administration  and 
contractor  performance. 

15.  Recognize  quality  contractors. 

16.  Review  application  and  use  of  certificate  of  conformance. 


Depot  (Supply  Management)  Phase 


The  primary  depot  (supply  management)  phase  objectives  are  to  improve  the 
effectiv^ess  of  destination  recdpt  insp^tions  and,  identify  and  purge  major 
and  critical  nonconforming  products  in  the  Defense  logistics  system  to  ensure 
that  only  conforming  products  are  shipped  to  operational  units. 

17.  Improve  the  effectiveness  of  destination  receipt  inspections. 

18.  Identify  and  purge  nonconforming  materiel  from  wholesale  level  inventory. 
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19.  Identify  and  purge  nonconforming  materiel  from  retail  level  inventory. 

20.  Identify  and  purge  nonconforming  spare  and  repair  parts  and  prevent 
reentry  into  the  DoD  supply  system  through  customer  returns. 


Feedback  Intelligence  Phase 


The  primary  feedback  intelligence  phase  objectives  are  to  improve  deficiency 
reporting  systems,  improve  inde^ndent  laboratory  testing  programs,  measure 
contractor  quality  performance,  identify  product  lines  that  are  susc^tible  to 
nonconformances,  and  identify  problem  contractors  that  supply  nonconforming 
products.  These  objectives  are  designed  to  target  quality  assurance  efforts  to 
preclude  acceptance  of  nonconforming  products. 

21.  Centralize,  automate,  collect,  and  share  contractor  performance 
information. 

22.  Enhance  the  use  of  DoD  and  indepoident  laboratory  test  capabilities. 

23.  Improve  the  customer  complaint  system. 

24.  Expand  participation  with  industry  associations  and  small  contractors. 

25.  Develop  measures  of  contractor  and  DoD  quality  performance. 

26.  Maximize  the  use  of  feedback  intelligence  to  improve  the  acquisition 
processes,  purge  defective  materiel,  and  improve  the  quality  of  DoD  spare  and 
repair  parts. 
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Objectives  and  Tnitiatives^^  Army  Navy  Air  Force 


Appendix  C.  Summary  of  Completed  and  Ongoing  Ihitiatiyes 
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Objectives  and  Ttiitiatives^  Annv  Navy  Air  Force 
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Obiectives  and  Initiatives^  Army  Naw  Air  Force 


Appendix  C.  Summary  of  Completed  and  Ongoing  biitiatives 
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Objectives  and  Initiatives^  Army  Navy  Air  Force 
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significant  initiatives  were  developed  for  this  objective. 


Depot  (Supply  Management)  Phase 


Appendix  C.  Summary  of  Completed  and  Ongoing  Initiatives 
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OWectives  and  Initiatives^  Annv  Naw  Air  Force 


Appendix  C.  Summary  of  Completed  and  Ongoing  Liitiatiyes 
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Objective  25:  Develop  measuies  of  extractor  and  DoD  quality 


Appendix  C.  Summaiy  of  Completed  and  Ongoing  Ihitiatiyes 
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Army 


Best  Value  Program.  The  Army  Aviation  and  Troop  Command  developed  this, 
program  to  consider  quality  and  delivery  performance.  Under  this  progi^, 
contracting  officers  evaluate  each  offerer  who  submits  a  proposal.  A  rating 
system  assigns  point  scores  based  on  quality  and  delivery  performance  during 
the  last  24  months.  Contract  awards  are  made  to  the  lowest-priced  best  value 
offerer. 

Blue  Ribbon  Program.  The  Army  Missile  Command  developed  this  program 
for  competitive  secondary-item  procurements  in  six  areas:  electro-optical,  c^le 
assemblies,  electronic  components,  mechanical  assemblies,  electro-mechanical 
assemblies,  and  electronic  assemblies.  Qualification  for  tltis  program  depends 
on  successful  past  delivery  performance  and  quality  performance.  A  contractor 
must  have  demonstrated  90  percent  on-time  delivety  and  quality  performance,  a 
quality  deficiency  rate  no  greater  than  1  percent,  a  first-time  quality  verification 
sample  rejection  rate  no  greater  than  10  percent,  and  a  first  article  test  rejection 
rate  no  greater  tiian  25  percent  during  the  last  24  months.  The  Army  can  pay  as 
much  as  a  10-percent  price  premium  to  lower  performance  risk  contractors  over 
a  low  non-blue  ribbon  offerer  to  increase  the  assurance  of  on-time  delivery  and 
quality  products. 

Blue  Ribbon  Program.  The  Army  Tank-Automotive  Command  developed  this 
program  for  the  procurement  of  spare  and  repair  parts.  This  program  considers 
a  contractor's  delivery  performance  rating  during  the  last  18  months  and  quality 
performance  during  the  last  24  months. 

Contractor  Performance  Certification  Program.  The  Army  Materiel 
Command  developed  this  program  to  encourage  contractors  to  enhance  the 
quality  of  products,  reduce  variability  in  product  quality,  and  use  process 
controls  in  the  production  process. 

Performance  Incentive  Contracting  Program.  The  Army  Armament, 
Munitions,  and  Chemical  Command  devdoped  this  program,  which  measures  a 
contractor's  delivery  performance  and  quality  performance. 


Navy 


Red,  Yellow,  Green  Program.  Red,  Yellow,  Green  is  a  contractor  rating 
system  based  on  a  contractor's  quality  history.  The  projgram  classifies  Ae 
degree  of  risk  by  assigning  a  color  to  a  contractor's  historical  product  quality 
performance  in  individual  Federal  supply  classes.  The  Navy  identifies  high-risk 
quality  performers  with  the  red,  moderate-risk  quality  performers  with  yellow, 
and  low-risk  quality  performers  with  green. 
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Air  Force 


Blue  Ribbon  Contract  Program.  The  Air  Force  Materiel  Command 
developed  this  program  to  recognize  contractors  who  have  maintained  high 
levels  of  performance,  bi  addition  to  recognition,  a  contracting  team  may 
award  a  contract  to  a  blue  ribbon  contractor  at  a  price  high^  than  the  lowest 
responsible  offerer. 

Vendor  Rating  System.  The  Air  Force  Materiel  Command  is  devdoping  this 
system  to  provide  each  offerer  historical  deliverv  and  quality  performance  data 
by  Federal  stock  class  or  by  total  business  conducted  with  Aiir  Force  hbiteriel 
Command  cratial  contracting  activities.  If  no  data  exist  on  a  specific  Federal 
supply  class,  then  all  other  Federal  supply  class  data  will  be  used.  The  vendor 
rating  system  will  provide  contracting  offices  on-line  visibility  into  the 
performance  of  all  contractors  who  supply  spare  parts  to  the  Air  Force.  The 
vendor  rating  system  will  recognize  boA  good  and  bad  performance.  Under  the 
vendor  rating,  contractors  will  be  classified  as  blue  (exceptional),  green 
(acceptable),  yellow  (marginal),  and  red  (unacceptable).  Tbe  data  will  be  used 
by  contracting  officers  to  evaluate  contract  awards.  Tlie  blue  ribbon  program 
and  the  vendor  rating  system  use  the  same  data  base.  The  projected 
implementation  date  is  September  1994. 

Defense  Logistics  Agency 


Automated  Best  Value  Model.  DLA  is  developing  this  program  to  automate 
data  collection  and  analysis  and  to  provide  a  means  to  evaluate  contractor 
quality  and  delivery  history.  Vendors  will  be  given  scores  based  on  quality  and 
delivery  performance.  Tbese  scores  will  be  used  by  contracting  officers  to 
evrduate  performance  risk  and  will  be  updated  monthly.  DLA  could  not  provide 
a  project^  implementation  date. 

Quality  Vendor  Program.  Headquarters,  DLA  developed  this  best  value 
buying  technique  to  recognize  contractors  who  have  demonstrated  a  history  of 
superior  performance  in  previously  awarded  Government  contracts.  The 
program  enables  a  contracting  officer  to  consider  past  quality  and  delivery 
performance  in  ^e  award  decision. 
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Appendix  E.  Summary  of  Potential  Benefits 

Resulting  From  Audit 


Recommendation 

Reference 

Description  of  Benefit 

Amount  and/or 
Type  of  Benent 

A.I. 

Internal  Controls.  Establishes  a 
policy  requiring  DoD  Components 
to  continuously  improve  their 
implementing  action  plans. 

Undeterminable. 

.A.2.a. 

Internal  Controls.  Establishes  the 
baselines  for  future  improvement, 
describes  the  actions  for  future 
improvement,  and  maintains 
implementing  action  plans  as  active, 
viable  management  tools. 

Nonmonetary. 

A.2.b. 

Internal  Controls.  Establishes  the 
performance  measures  for  the 
effectiveness  of  the  initiatives  in  the 
DoD  Component  implementing 
action  plans. 

Nonmonetary. 

A.2.C. 

Internal  Controls.  Establishes 
definite,  realistic,  and  obtainable 
milestones  for  DoD  Components  to 
complete  initiatives  and  actions  in 
tile  implementing  action  plans. 

Nonmonetary. 

A.2.d. 

Internal  Controls.  Assigns 
accountability  and  responsibility  to 
the  proper  office  for  management 
oversight. 

Nonmonetary. 

B.l.a. 

Program  Results.  Standardizes 
the  DoD  procurement  community 
approach  toward  rating  the 
performance  of  vendors. 

Undeterminable. 

See  footnote  at  end  of  appendix. 
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Appendix  E.  Summary  of  Potential  Benefits  Resulting  IVom  Audit 


Recommendation 

Reference  Description  of  Benefit 


Amount  and/or 
of  Benefit 


B.l.b. 

Compliance.  Requires  DoD 
Components  to  issue  regulatory 
guidance  to  comply  wiA  10  U.S.C. 
2383  that  requires  critical  aircraft 
and  ship  parts  to  be  conforming. 

Undeterminable.  * 

B.2.a. 

Program  Results.  Updates  action 
plan  initiatives  to  enhance 
competition  and  assists  contractors 
in  obtaining  accurate  technical  data 
to  manufacture  parts. 

Undeterminable.  * 

B.2.b. 

Compliance.  Updates  action  plan 
initiatives  to  inform  all  Federri 
agencies  of  quality  problems  in 
accordance  with  Government- 
Industry  Data  Exchange  Program 
Requirements. 

Undeterminable.  * 

B.2.C. 

Program  Results.  Updates 
initiatives  that  will  lead  to 
improvements  in  the  DoD-wide 
Deficiency  Reporting  System. 

Nonmonetary. 

B.2.d. 

Program  Results.  Creates  an 
initiative  to  reduce  and  standardize 
the  number  and  use  of  forms  for 
reporting  nonconforming  products. 

Nonmonetary. 

B.2.e. 

Program  Results.  Updates 
initiatives  to  improve  the  use  of  the 
PQDR  Program  through  training. 

Nonmonetary. 

B.3.a. 

Program  Results.  Establishes  an 
objective  to  support  the 
development  of  a  consistent 
approach  to  vendor  ratings. 

Nonmonetary. 

See  footnote  at  end  of  appendix. 
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Appendix  E.  Summary  of  Potential  Benefits  Resulting  Prom  Audit 


Recommendation 

Reference  Description  of  Benefit 


Amount  and/or 
Type  of  Benefit 


B.3.b. 

Compliance.  Establishes  an 
initiative  to  verify  compliance  with 
regulatory  guidance  that  requires 
contractors  to  supply  conforming 
critical  aircraft  and  ship  parts. 

Nonmonetary. 

B.3.C. 

Program  Results.  Creates  an 
initiative  that  seeks  to  provide 
contractual  remedies  for  DoD  to 
recoup  cost  of  products  found  to 
contain  patent  defects  after 
acceptance. 

Undeterminable. 

B.3.d. 

Program  Results.  Establishes  a 
series  of  initiatives  to  remove 
nonconforming  products  from 
inventories  and  attempt 
recoupments. 

Undeterminable. 

B.3.e. 

Program  Results.  Creates  an 
objective  to  direct  laboratory  testing 
efforts  towards  previously  identified 
problem  product  lines  and  problem 
contractors. 

Undeterminable. 

B.3.f. 

Program  Results.  Creates  an 
initiative  to  improve  the  quality  of 
laboratory  test  plans. 

Nonmonetary. 

B.4. 

Program  Results.  Establishes  an 
initiative  to  test  suspect  product 
lines  and  remove  nonconforming 
products  from  the  depot  before  tiiey 
are  issued  to  operational  units. 

Undeterminable. 

Nonmonetary. 

B.5.a. 

Program  Results.  Creates  an 
objective  that  enables  contracting 
activities  to  perform  more  effective 
contractor  past-performance 
evaluations  in  the  source-selection 
process. 

See  footnote  at  end  of  appendix. 
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Appendix  £.  Summary  of  Potential  BeneHts  Resulting  From  Audit 


Recommendation 

Reference 


B.5.b. 


B.5.C. 


B.5.d. 


B.5.e. 


B.5.f. 


Description  of  BeneHt 


Program  Results.  Establishes 
an  initiative  to  measure  the 
effectiveness  of  each  contractor's 
quality  control  program. 

Program  Results.  Establishes  an 
objective  to  implement  a  standard 
approach  for  contracts  containing 
International  Organization  for 
Standardization  quality  system  series 
requirements. 

Program  Results.  Creates  an 
initiative  to  develop  training  in 
International  Organization  for 
Standardization  quality  system  series 
requirements. 

Projgram  Results.  Establishes  an 
initiative  to  measure  the  continuous 
improvements  in  quality  controls  at 
contractor  facilities. 

Program  Results.  Creates  an 
objective  to  reduce  the  chances  that 
nonconforming  products  will 
interrupt  depot  manufacturing 
processes. 


Amount  and/or 
Type  of  Beneflt 


Nonmonetary. 


Nonmonetary. 


Nonmonetary. 


Nonmonetary. 


Undeterminable.  * 


^Monetary  benefits  cannot  be  reasonably  estimated. 


Appendix  F.  Organizations  Visited  or  Contacted 


Office  of  the  Secretary  of  Defense 

Under  Secretary  of  Defense  for  Acquisition  and  Technology,  Washington,  DC 
Director  of  Defense  Procurement,  Washington,  DC 
Assistant  Secretary  of  Defense  (Production  and  Logistics),  Washington,  DC 
Joint  Logistics  Systems  Center,  Dayton,  OH 
Deputy  Assistant  Secretary  of  Defense  (Logistics),  Washington,  DC 
Deputy  Assistant  Secretary  of  Defense  (Production  Resources),  Washington,  DC 
Program  Manager,  Total  Quality  Management,  Office  of  the  Director,  Administration 
and  Management,  Washington,  DC 


Department  of  the  Army 

Office  of  the  Chief  of  Staff,  Washington,  DC 

Army  Materiel  Command,  Alexandria,  VA 

Army  Missile  Command,  Huntsville,  AL 

Corpus  Christi  Army  Depot,  Aviation  and  Troop  Command,  TX 


Department  of  the  Navy 

Office  of  the  Assistant  Secretary  of  the  Navy  (Research,  Development,  and 
Acquisition),  Washington,  DC 

Office  of  the  Assistant  Secretary  of  the  Navy  (Financial  Management), 

Washington,  DC 

Naval  Air  Systems  Command,  Washington,  DC 
Naval  Aviation  Depot,  North  Island,  CA 
Naval  Aviation  Depot,  Alameda,  CA 
Naval  Sea  Systems  Command,  Washington,  DC 
Portsmouth  Naval  Shipyard,  Portsmouth,  NH 
Naval  Supply  Systems  Command,  Washington,  DC 
Fleet  Material  Support  Office,  Mechanicsburg,  PA 
Naval  Aviation  Supply  Office,  Philadelphia,  PA 
Navy  Ships  Parts  Control  Center,  Mechanicsburg,  PA 
Naval  Material  Quality  Assessment  Office,  Portsmouth, 

Supervisor  of  Shipbuilding,  Conversion,  and  Repair,  San  Diego,  CA 
Commander,  Naval  Air  Pacific  (Antisubmarine  Warfare)  Wing,  Naval  Air  Station, 
San  Diego,  CA 

Commander,  Shore  Intermediate  Maintenance  Activity,  Naval  Surface  Pacific  Fleet, 
Naval  Station,  San  Diego,  CA 
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Appendix  F.  Organizations  Visited  or  Contacted 


Department  of  the  Air  Force 

Office  of  the  Assistant  Secretary  of  the  Air  Force  (Management  Policy  and  Program 
Integration),  Washington,  DC 

Office  of  the  D^uty  Cmef  of  Staff  (Logistics),  Washington,  DC 
Air  Force  Materiel  Command,  Wright-Patterson  Air  Force  Base,  OH 
Ogden  Air  Logistics  Center,  Hill  Air  Force  Base,  UT 
Sacramento  Air  Logistics  Center,  McClellan  Air  Force  Base,  CA 
San  Antonio  Air  Logistics  Center,  Kelly  Air  Force  Base,  TX 


Defense  Organizations 

Defense  Logistics  Agency,  Alexandria,  VA 

Defense  Contract  Management  Command,  Alexandria,  VA 
Central  Testing  Facili^,  Columbus,  OH 
Western  Testing  Facility,  Stockton,  CA 
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Appendix  G.  Report  Distribution 


Office  of  the  Secretary  of  Defense 

Under  Secretary  of  Defense  for  Acquisition  and  Technology 
Director  of  Defense  Procurement 
Assistant  Secretary  of  Defense  (Economic  Security) 
Comptroller  of  the  Department  of  Defense 
Director,  Administration  and  Management 
Program  Manager,  Total  Quality  Management 
Deputy  Under  Secret^  of  Defense  (Logistics) 

Director  of  Materiel  and  Resource  Management 


Department  of  the  Army 

Secretary  of  the  Army 

Assistant  Secretary  of  the  Army  (Financial  Management) 

Assistant  Secretary  of  the  Army  (Research,  Development,  and  Acquisition) 
Chief,  Army  Management  Division,  Office  of  the  Chief  of  Staff 
Commander,  Army  Materiel  Command 
Auditor  General,  Department  of  the  Army 


Department  of  the  Navy 

Secretary  of  the  Navy 

Assistant  Secretary  of  the  Navy  (Financial  Management) 

Assistant  Secretary  of  the  Navy  (Research,  Development,  and  Acquisition) 
Inspector  General,  Department  of  the  Navy 
Commander,  Naval  Supply  Systems  Command 
Auditor  General,  Naval  Audit  Service 


Department  of  the  Air  Force 

Secretary  of  the  Air  Force 

Assistant  Secretary  of  the  Air  Force  (Acquisition) 

Assistant  Secretary  of  the  Air  Force  (Financial  Management  and  Comptroller) 

Deputy  Chief  of  Staff  of  the  Air  Force  for  Logistics 

Commander,  Air  Force  Materiel  Command 

Inspector  General,  Department  of  the  Air  Force 

Auditor  General,  Air  Force  Audit  Agency 
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Appendix  G.  Report  Distribution 


Defense  Organization 

Director,  Defense  Logistics  Agency 


Non-Defense  Federal  Organizations 

Office  of  Management  and  Budget 

National  Security  and  International  Affairs  Division,  Technical  Information  Center, 
General  Accounting  Office 

Chairman  and  Ranking  Minority  Member  of  Each  of  the  Following  Congressional 
Committees  and  Subcommittees: 

Senate  Committee  on  Apprc^riations 

Senate  Subcommittee  on  Defense,  Committee  on  Appropriations 

Senate  Committee  on  Armed  Services 

Senate  Committee  on  Governmental  Affairs 

House  Committee  on  Appropriations 

House  Subcommittee  on  Defense,  Committee  on  Appropriations 
House  Committee  on  Armed  Services 
House  Committee  on  Government  Operations 

House  Subcommittee  on  Legislation  and  National  Security,  Committee  on 
Government  Operations 
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Part  IV  -  Management  Comments 


13 


Deputy  Under  Secretary  of  Defense  (Logistics) 
Comments 


OFFICE  OF  THE  UNDER  SECRETARY  OF  DEFENSE 

3000  OEFENSC  PENTAGON 
WASHINGTON  DC  20G0t-30C» 

t  4  ffH  m 


(L/MBM) 


HBOtAHDUH  JOSL  DOD  INSPECTOR  GENERAL 

SUBJECTS  DrisXt  Audit  Report  on  DoD  Cooqponont  Inplsmentlng  Action 
Plans  for  la^roving  the  Quality  of  spare  Parts  (Project 
Ho*  2CF-0053) 

This  responds  to  your  lacmorandum  of  Bov^nber  17  ^  1993 ,  on  tho 
subject  draft  audit  report*  There  is  one  rocoonondation.  In  two 
parts,  for  the  Under  Secretary  of  Defense  (Acquisition  and 
Technology)! 

"1.  no  reconmend  that  the  Under  Secretary  of  Defense  for  Acqaisiticms 

a*  Select  a  standard  DoD  vendor  rating  system  for  use  in  DOD* 

b.  Establish  regulations  for  InplssiBnting  United  States  Coda, 
title  10,  section  2383,  to  require  that  contractors  supplying 
critical  aircraft  and  ship  parts  moet  appropriate  qualification  and 
contraotual  quality  roquirenents ,  ** 

This  office  proposes  alternate  methods  of  lUBBtlng  the  Intent  of 
these  reconi^dations.  The  possible  estahlishnent  of  a  standard  DoO 
vendor  rating  system  is  a  coznplex  issue  that  has  received 
oonsiderable  attention  frcm  the  DoO  Ccinponents.  Further  review  will 
bo  conducted  by  the  DoD  Past  Performance  Coordination  Council  and 
rsoesmendations  forwarded  to  0U3D  (Acquisition  and  Technology)  by 
July  1995. 

In  regard  to  United  States  Code,  title  10,  Section  23B3,  repeal 
of  this  section  was  proposed  in  S.1587  introduced  by  Senator  Glann  on 
October  26,  1993.  In  view  of  the  likelihood  of  legislative  relief, 
additional  action  by  the  Department  is  not  apprqpriate  at  this  time. 


y  I 

/James  R,  Xlugh 
Deputy  Under  Secretary 
of  Defense  (Iiogiatica) 
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Department  of  the  Army  Comments 


tl&>ARnmHl  OF  THE  ARMV 
orace  Of*  rm  MamrMa  tacnrrAMf 
HEICAMH  DtVfLOmEKT  AND  ACOUnmON 
m  AAMVI-ENTADON 
waammvton  DC  ttl)  Asm 


SARD-DX 


January  31^  1994 


NEMORAVDOM  TOR  DIRECTOR,  CORTRACT  KAKAGBKERT,  OFFICE  OF  THE 
INSPECTOR  GENERAL,  DEFARTHENT  OF  DEFENSE, 
ATTNt  MR.  SALVATORE  D.  GDLX 

SUBJECT;  Raport  on  DoD  Coaponant  Ziq;klamantlng  Action  Pl&na 
for  Improving  tha  Ouality  of  Spara  Parts  (Projoct 
No.  2CF^0053) 

X  hava  reviavad  tha  aubjact  draft  audit  raport  for  tha 
Of  flea  of  tha  Aaaiatant  Bacratary  of  tha  Army  (Rasaarch, 
Davalopmant  and  Acguialtion) «  D^a  attaohad  ccunnenta  ara 
provldad  for  your  cons Idarat ion  for  Incluaion  in  tha  final 
report. 

Point  of  contact  for  this  action  la  LTC  Hike  Murphy, 
(703)  695-7616. 


S^aphon 
Director  for  Jgrj 


ion 


Attaobaant 

CF. 

SAAG-PRF-E 

AKCRD-ZEB 


0 
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Department  of  the  Army  Comments 


FROMf  OXSA(RDA}/aABD«‘DE,  Washington  D*C.  20310-0103, 

Lie  Hurphy^  DSN  225-7616 

Draft  Audit  Report:  DoD  Cofsponent  ImploManting  Action  Plans 
for  isproving  Quality  of  Spare  Parts  (Projaot  Mo-  2eP-0053) 

gen-ral  etament.  Ar»y  dOM  liOt  concwr  wltk  atataMUta  In 
the  DoD  IG  report  concerning  tha  Materiality  of  Hanagenent 
control  weaxnaesas.  Amy  has  bad  a  nunbar  of  initiatives 
undanray  since  tha  Initial  raport  that  apply  directly  to 
acguisltiott*  Ihese  initiativas  include  acquisition 
isproveaent  saainars  coaaonly  known  aa  "Road  Bbov«"  In 
March  1992,  OASA<RDA)  and  AMC  executives  travelled  to  the 
AMC  Major  Subordinate  Coanands  to  present  Roadshow  I  to  tha 
aanior  nanagera.  This  presentation  explained  tha 
fundaaantala  of  how  the  Amy  auat  change  the  way  it  obtaine 
Ite  materiel  regulraaente  in  order  to  fulfill  its  mission  in 
the  future.  An  expanded  seminar  for  aid-level  managers. 
Roadshow  II,  explains  the  principles,  conducts  case  studies 
on  how  these  principles  can  be  applied,  and  providea  a 
real-life  examination  of  hov  raguiremente  can  be 
streamlined.  Roadshow  II  has  trained  nearly  2000 
acquisition  employees  on  streamlining  acquisition  principles 
during  FV93.  A  version  of  Roadshow  II  haa  been  presented  to 
industry,  statistical  prooess  control  is  being  utilized  in 
spares  a^  new  system  contracts.  AKC  also  has  a  program  to 
work  with  contractors  to  improve  product  quality.  This 
program,  known  as  the  Contractor  Performance  Certification 
Program  (CP)*,  encourages  contraotors  to  iapleaent  process 
control  and  continuous  improvement  principles.  The  (CP)* 
program  ie  being  expanded  to  include  Continuous  Process 
laprovemsnt  (CPI) .  The  expanded  program  will  provide 
extensive  metrics  as  well  as  including  design  paramet^s  f or 
contraotors.  Army  taelleves  that  these  and  other  initiatives 
are  objective  evidence  of  our  intent  to  improve  the  quality 
of  spare  and  repair  parts.  The  original  Army  plan  was  not 
intanded  to  be  a  long  range  responsa.  Conclusione  drawn  in 
the  report  that  a  material  weakness  exists  are  based  on  the 
premise  that  the  original  plans  were  intended  to  serve  as 
long  range  rasponsea  to  this  area. 

Finding  A,  Recommendation  page  13* 

Me  recommend  that  the  Assistant  secretaries  of  tha  Army  and 
Havy  (Ressarch,  Development  and  Acquisition),  the  Assistant 
Gacretary  of  tha  Air  Force  (Acquisition)  ,  end  the  Director, 
Defenmm  x:x>gi8tlos  Agency: 
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Department  of  the  Army  Comments 


Mndin?  A,  KacoMMAndation  l«/  13* 

Batabliah  policiaa  ±jo  ralasua  upda1:ad  plana  tor  iaplamonting 
t:ha  OoD  Action  Plan  for  Continuously  laproving  tba  Quality 
of  SpmT^i  and  Repair  Parts  svsry  2  ysars  beginning  PY  1994  to 
traw  quality  iaprovaasnt  aocoaplislxasnts. 

oxsAfRDAl  pQgitlont  Concur  vith  inttsnt  of  roooBraandation  to 
iqidata  action  plan.  Howovar,  ths  raquireaant  to  update  the 
plan  avary  two  years  is  arbitrary  .and  allows  insuff  icient 
tisa  to  lipleRsnt  changoB  and  Rsasura  rsaiiltB*  Sarvicas 
ahould  ba  allowed  to  update  the  plan  based  on  initiative 
raquireoaents  and  as  deemed  necaaaary  by  Service  nanagement. 


Finding  A^  Racoameiuiationa  2. a.  -  2«d.,  Page  13. 

Batablieh  accountability  for  achieving  impleaantlng  action 
plan  objectives  and  for  improving  the  quality  of  spare  and 
repair  parts  by: 


a.  Updating  implenanting  action  plans  to 
include  detailed  in-prooess  and  planned  initiatives  for  OoD 
Action  Plan  objectives. 

b«  Updating  implenanting  action  plane  to 
oontain  perfornanca  measures  to  measure  the  ef  feotivenoas  of 
Bsch  initiative  in  accosplisliing  DoD  Action  Plan  objeotives. 

c.  Updating  implementing  action  plans  to 

include  definitar  realistic  and  obtainable  nileatones  for 
completion  of  initiatives  ixi  the  action  plans. 

d«  Assigning  organisational  responsibility 

for  nanagemsnt  oversight  for  Implementing  action  plan 
objectives  and  for  obtaining  faedbacb  on  the  adequacy  of  the 
initiatives  suiqporting  the  objectives. 

Q^SA(RDA1  position!  CohouT.  SARD-DE  in  Conjunction  with 
the  U.  S.  Army  Materiel  command  will  update  and  reissue 
action  plan  by  1  June  3994.  Army  will  include  performance 
Masuras,  realistic  milestones  and  will  assign 
organisaticmal  responsibility  of  management  oversight. 


2 


final  Report 
Reference 


Revised 


Page  14 
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Department  of  the  Army  Comments 


Final  Report 
Reference 


Page  32  Finding  B.  Adiiguacy  of  inplononting  Action  Plane* 

rinding  BnaoinMndatlon  2ta*i  page  27« 

We  Tmsxmmmnd  that  the  Aseietent  Becreterlee  of  the  Airny  end 
Mevy  (RBseerch,  Developeent  end  Aoguisitlon) ,  Ihe  AMistant 
searetary  of  the  Air  roroe  (Acquisition}*  and  the  Director, 
Defonae  Loglatice  Agency*  u]^te  their  InpleBenting  action 
plane  to  show  the  current  or  planned  actlona  to; 

e«  Maintain  technical  data  peotagee  and  nake  then 
available*  adequate,  end  eocurate  ae  an  inltietive  for 
objective  a;  ensure  technloal  date  are  available*  aiiequete* 
end  accurate  for  use  in  acquiring  quality  parte* 

OARAfRDAI  ocaition;  Nonconcur*  The  initiative  should  be  to 
use  parfomance  specifications  in  lieu  of  detail 
specif  lest  ioxui.  The  thruet  of  recent  Roadshows  II  a  III  has 
bimn  to  etress  use  of  perforeance  apeoif  lost  ions.  Use  of 
perforaence  specif  lost  ions  vilX  reduce  the  naintenance  of 
Teohnical  Data  Paokegea  (TDP)  by  elininating  drawing 
requiramants.  Perfonance  specificatione  will  eleo  allow 
oontraotors  to  apply  new  technology  to  mast  requireinents* 

Use  of  new  technologies  can  be  expeotad  to  keep  acquisition 
costs  down  for  the  Amy.  Also*  AKC  has  several  on^^oing 
initiatives  to  isprove  the  acquisition  and  quality  of  data. 
Digital  Storage  and  Retrieval  Sngineerlng  Data  Syatems 
(DSREDS)  have  been  installed  at  ell  the  buying  MSCs*  ell 
eotive  drawings  have  bean  loaded  into  the  new  eystees  and  an 
autosated  Tachnical  Data/Configuration  Management  systea  has 
been  installed  to  control  changes  and  design  upgrades.  A 
perfomance  specification  guide  has  been  prepared  and  is  in 
coordination.  The  guide  is  Intended  to  foster  conwerciaX 
buying  practices.  In  addition*  Storage  and  Retrieval  and 
Configuration  Control  systess  are  being  designed  for 
Dsfensa-vids  applioation.  Prototype  testing  is  being  done 
at  AMC*8  Missile  CoDonand  using  DSStEDS  and  TD/CKS  as  the 
standard. 

Page  33  Finding  B«  Recosnandation  2.b»*  page  27* 

b.  Conply  with  the  reqairements  of  Office  of  Federal 
Procurenent  Policy  lAtter  No.  91-3*  ^Reporting  Konoanfoming 
Products***  to  participate  in  the  Government-industry  Data 
Bxohange  Program  as  an  initiative  for  Objective  23*  Improvs 
the  Custooer  Complaint  fiysten. 

OASAfRDi,^  pQgitioni  Concur.  AKC  Major  Subordinate  Costmands 
(M5C)  regularly  participate  in  the  GIDRF  prograsi. 
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rinding  Beconsumdation  2.a«p  p&ga  27* 

e*  Buj^port  tha  davaXopMiit,  planned  deploywant  and 
inplraantation  of  thm  DoD-vida  DaCioianqy  Kaporting  Syatan 
aa  an  initiative  for  objective  a3«  iaprofva  the  euatoiear 
conplaint  eyatan. 

OAgAfHDAI  poflitloni  Concur*  AMC  Xxtgiatice  Bui^port  Activity 
and  xiaaila  Comsand  (KXCON)  are  Amy /AMC  lead  aotivitiee  for 
davelopoent  and  dapXoynant  of  the  DoD-wide  Defloianoy 
Reporting  Systan.  logba,  MICOM^  AMCCOK  A  TACOK  have  had  an 
actlva  axvd  continuing  role  in  developeent  and  deployeant  of 
the  DoD*-vide  DRS. 

rinding  Recoemendation  2.d.,  page  28« 

d.  Reduce  the  number  of  fores  used  to  report 
nonconforaancasi  and  standardize  the  forms  and  the  use  of 
the  fores  as  inltiativas  for  Ob j active  23#  Znprove  the 
Cuatoaar  Coaplaint  Syatem. 

QKSAfRDA)  BOBltlon;  ConouT.  Aotlon  la  alraady  undanmy  to 
the  Defense  Logistics  ManagaeBnt  Systems  Office  (DLNSO)  with 
the  ANSI  X12  electronlo  data  interGhanga  convention 
nonconformance  report*  Thie  convention  will  be  uaed  to 
report  QDR«e,  ROD'Sa  and  transportation  Defioienoy  Reports. 
DUfSO  aaqpecta  to  begin  service  staffing  of  this  convention 
in  January  1994. 

Finding  B#  Racoeaendation  3. a.,  page  28. 

Re  recomsend  that  the  Assistant  Saaretarles  of  the  Army  end 
Navy  (Research,  Davalopeant  and  Acquisition) ,  The  Assistant 
Sacretary  of  the  Air  Force  (Acquisition) ,  end  the  Director# 
OoCense  Logistioa  Agency#  update  their  iepleeentlng  action 
plans  to  show  the  current  or  planned  actions  tos 

a.  Support  an  sffort  to  identify  and  designate  one 
eystee  as  the  standard  OoD  vendor  rating  system  as  part  of 
an  additional  objective  to  the  pre-contract  phase# 

QASAfBffA) . Hflaltlpnt  concur.  Army  will  support  this 

initiative  ae  required  by  DSD<A)  *  This  will  bs  passible 
with  the  DOD  DRS. 
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Page  36 


Vlnalng  B,  RaaovoMndatloit  3.b. ^ 

b*  Do«orib«  th4i  aatloiui  tak«ii  to  cceaply  with  ITnitod 
Btateo  Godo,  tltlo  10|  aeotlon  23S3|  "Froamrcment  of 
Critical  Aircraft  and  Ship  Parts,”  aa  an  initiativs  for 
Objactiva  7,  Bnaura  All  Suppliars  of  Spars  and  Bapalr  Parts 
Hast  Spaaifiad  Quality  and  Tachnlaal  RoQuirasanta* 

QAflAfRDA>  poaitloni  Concur.  Tha  Amy  has  had  an  acstiva  and 
effactlva  Critioal  Safety  Itas  Progran  (CSXP)  ainea  1P85« 
During  calendar  year  1989,  a  ccmplete  ravlav  of  the  progras 
was  perfomad.  Reocnoiiended  changes  have  been  incorporated 
Into  a  revision  to  AXC-R  702-33,  29  Aug  90*  Additionally, 
we  hava  alao  incorporated  tha  C5IP  Into  Aray  policy  and 
published  it  in  an  Amy  Regulation  (AR  7S0-1) ,  1  Mov  91. 

Finding  B,  Raaonsandation  3.e*,  page  28. 

c*  Support  devalopsant  of  oontractual  policy  propoaala 
to  obtain  reiabursaaant  or  replaceaMHit  for  products  accepted 
by  the  Covemmant,  but  later  found  to  contain  patent  defects 
as  an  initiative  for  objective  8,  Reject  or  Retire 
Correotlona  of  Ronconfoming  supplies* 

DABA (BPA>. .JMSitittP:  Concur.  As  part  ol  the  Quality 
Deficiency  Report  (QDR)  program,  contractors  are  held  liable 
and  are  required  to  provide  restitution  to  tha  Aray  for 
aatarial  accepted  and  later  found  to  be  defective •  This 
prograa  la  laplemanted  at  the  AMC  buying  ooisi&emds*  Where 
there  is  a  warranty  in  effect,  the  contractor  la  required  to 
ooaply  with  the  warranty*  Statistical  Procasa  control  (SPC) 
is  alao  being  stressed  as  part  of  our  continuous  laprovement 
effort*  Continuous  isq^roveaent  la  process  oriented  and 
focuses  on  defect  prevention  rather  than  detection*  A 
Defense  Federal  Acquisition  Regulation  case  to  elininata 
conclusiveneas  of  acceptance  of  defective  products  was 
presented  to  the  Defense  Aaguisitlon  Regulation  <DAR) 

Council  in  1991.  OAR  council  has  not  yet  accepted  this  case 
for  action* 
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Finding  Baconnandatlon  3.d.«  pagn  28. 

d.  Rwnova  nonconforning  product*  Idantifiod  on  product 
Quality  Dofiolonoy  iieport*  from  Dofana*  Supply  8y*ta» 
invantoria«|  notify  oontraetom  vhan  their  noneonfoTBixig 
proituate  ere  discovered  end  provide  ooplee  of  guelity 
dciflclency  infomation  to  Contractora  eo  the  contractor  can 
oorreot  the  cause  of  the  quality  control  failure  |  Inf  on 
contracting  offioara  eo  they  can  attaapt  to  raccnap  the  value 
of  the  nonaonfonlng  prodocta;  and  docunent  the  quality 
assurance  decisione  to  raquaat  or  not  raquaat  laboratory 
taatlng  needed  to  support  Product  Quality  Deficiency  Report 
as  initiatives  for  Objective  23 ^  Xsprove  the  custoner 
Cosqpieint  Systes. 

QAgAfBDAi  poaltlons  Concur  with  intent.  Hhe  Amy  uses  AR 
702-7  to  react  to  PQDR  type  X  and  type  XX  non-conformanca* 

We  also  utilias  safety  of  flight,  safety  alert  end  eupply 
alert  sassages  that  provide  Instructions  on  defective 
materiel  that  has  been  found  at  the  retail  levele.  currant 
procedures  are  satisfactory,  sathods  are  in  place  to 
Identify  non-oonforslng,  discrepant  parts  in  the  retail 
Inventory.  Honoonforalnq  etocke  are  already  being  frozen 
froa  issue  by  using  condition  code  Q  until  ths  problea  is 
rssolved.  Xf  the  user  disoovere  a  problem,  it  le  reported, 
to  the  Source  of  Supply  (SOS)  vis  the  QDR  proceee.  Once  the 
itsa  manager  confirme  the  probles  end  Identifies  the  scope 
of  the  Iseue,  guidance  is  Issued  to  the  field  via  messages, 
nevslettare,  PK  magasine,  etc.  Othere  are  discovered  fay  the 
'idiolesale  manager  and  faroadoast  to  the  field  in  the  same 
manner.  Depending  on  the  nature  of  the  problem  and/or  the 
use  of  the  item,  the  808  vill  lesue  a  ”safaty  of  use,"  or 
"Safety  of  Flight"  saasage.  Xhesa  are  flashers  to  the  field 
that  identify  alspiif leant  problems  and  request  immediate 
remedial  action.  At  the  sane  time,  ths  Loglstio  Assistance 
Representative  (LAR)  network  is  used  to  identify,  confirm 
and/or  segregate  non-conforming  inventory.  Also,  item 
managers  recoup  costs  from  defective  items  on  s  case-by-case 
basis.  Rscoupmant  typically  results  froa  negotiations  with 
the  contractor  Involved.  The  Arsy^’s  position  la  that  no 
changes  are  needed  to  meet  the  intent  of  this 
recommendation. 
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Page  38 


Findlngr  ItnoonnondJition  png*  28. 

••  Dnvnlc^  BtratogiaB  tar  Qomt  •ffBOtivnly  tinrgating 
quality  aaauranoa  laboratory  testing  to  i^iontify  susoaptlble 
product  linos  and  problem  contractors,  and  to  randcmly  test 
the  products  supplied  by  problem  suppliers  at  every  national 
inventory  control  point  as  an  added  objactiva  for  tba 
feedback  intaIXigance  phase. 

QASAtRDAl  PQsltlQii;  partially  concur.  Concur  with  qusllty 
assuranoa  laboratory  testing  on  a  linltod  basis.  Over  the 
past  several  years  the  Army  has  ambraced  the  philos<^y  of 
Total  Quality  Kanagenent  (TOM)  for  acquisition.  This 
embrace  aDphasiaes  "prevention"  vs.  "detection"  of  defectm 
as  a  strategy  for  the  inprovemant  of  tbs  quality  of  all 
procured  Army  material.  By  am>loying  continuous 
ittprovement  aspect  of  TQK  to  spares  and  repair  parts ^  va 
have  dacraased  the  risk  to  the  Govemasnt  and  increased  the 
risk  to  the  contractor,  lihere  quantities  pemit  use  of 
statistical  process  control  In  the  production  process, 
def«rat  prevention  and  control  of  proceeaes  are  replacing  the 
praotloe  of  defect  detection  and  end-of-line  Inspaotlon.  We 
believe  this  recommendation  should  be  modified  to  expand  the 
use  of  process  csontrol  during  manufacture,  yAmvm  feasible, 
but  maintain  use  of  laboratory  testing  idien  a  first  article 
is  required  and  production  quantity  is  not  adequate  for 
application  of  8PC. 

Tindlng  B,  Itacommendation  3.f.,  page  38. 

f*  Bvaluate  the  adequacy  of  quality  assurance 
laboratory  test  plans  as  an  initiative  for  Objective  23, 
Enhance  the  Use  of  DoD  and  Independent  Laboratory  Test 
Capabilities. 

QASA(RDAi  position  i  Partially  concur.  See  concerns  oited 
above. 
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rinding  RaooiuiMndatlon  4. 

W«  vcommmnd  that  tha  Aaalatant  Sacnratarlaa  oC  tha  hr&y  and 
Navy  (Raaaaroh,  DavaLc^ent  arid  Acqulaitlon) ,  and  Tha 
AsBlatant  Saox-etary  of  tha  hlr  Foroa  (Acquiaition)  raviaa 
tha  Kilitary  Dapartaant  iaplamanting  aotlon  plana  hy  atlding 
an  initiativa  to  taat  product  llnaa  atorad  in  dapot 
Invantoriaa  auapaoted  of  containing  ncmconforming  products 
aa  part  of  Objeotiva  IS,  Identify  and  Purga  Nonconfoming 
Material  from  miolesale  Laval  Invantory* 

ORSAfRDA^  PQflitiont  Concur  with  intent.  Thia  la  already 
being  done,  vtxara  ^propriata,  through  nomal  cyclic 
Inapaotlon  and  Cara  of  Supplies  in  Etoraga  (OOSIS) 
wooaduraa.  Rationale  for  raooii»andatioa  3 .a.  also  applies 
in  thia  situation.  Wa  do  not  believe  that  ehangas  ara 
naoBfisary  in  order  to  meet  tha  intent  of  this 
reccmnenda t ion • 
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DEPARTMENT  OF  TTiE  NAVY 

OFHCF  OFTME  ASSISTANT  SECRETARY 
(RmqakA  DftiWxwwrtl  *«iuKiHqn)  .  . 

WASNINOTON.  PC  e0350>}000  Iv 


KEHOKANOUK  FOR  THE  DEPAKTHEKT  OP  DRFEHHE  ASSISTANT  INSPECTOR 
GENSRAL  FOR  AUDITING 

subj:  DODZa  DRAFT  AUDIT  REPORT  OK  DOD  COHPONENT  XMPIiEKENTZNG 

PLANS  FOR  IMPROViNa  TUB  QUALITY  OP  SPARE  PARTS  (PROJECT 
MO.  3CF-005I) 

Etiol:  (1)  DON  Response 

In  reply  to  your  veaorendvuD  of  17  Koveeber  1993,  wv  staff 
has  reviewed  the  findings  and  reconuumdatione  in  the  subject 
report.  Ne  concur  with  the  finding  concerning  the  adequacy  of 
Xiqilementing  Action  Plans  and  with  the  reconaaendatlone. 

We  concur  with  the  recommendation  that  Navy  develop  policy 
for  reissuing  updated  plans.  That  policy  will  be  developed  and 
is  eRpected  to  be  published  in  December  1994.  Kavy  proposes 
continual  update  of  the  action  plan  In  lieu  of  updating  every  two 
years. 

We  czonimr  with  updating  and  revising  the  Navy's 
Imp  lamentation  Plan.  This  update  was  euhmitted  to  the  Deputy 
Under  Secretary  of  Defense  (DUSD)  (Logistics)  in  December  1993. 
Navy  proposes  replacing  the  current  Implementation  Plan  with  an 
action  plan  that  is  long  rai^fe  in  nature  and  better  suited  for 
use  as  a  management  tool.  A  TaaX  Action  Team  will  be  formed  in 
February  1994  to  accomplish  this  task  and  the  plan  is  expected  to 
be  finalised  30  November  1994. 

We  do  not  concur  with  the  finding  that  claims  material 
internal  control  waabnesses.  Conclusions  concerning  Internal 
control  cannot  be  made  solely  on  whether  or  not  official  updates 
to  the  Navy  Implementation  Plan  were  submitted  to  DUSD 
(Logistics) . 

Detailed  comments  are  provided  in  enclosure  (1) * 


B.  B. 

RAUN,  sev  USN 

Deputy  for  Acquisition  Policy 
Integrity  and  Accountability 


Copy  tot 
NAVINSGEN 
NAVCOKPT  (NCa-53) 
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DK?ARTKXNt  OF  THK  VAFY  nspoisi 
TO 

Dooxc  DAArv  RiKmT  or  rovxufin  n,  1993 

OK 

DOO  OOKFOnirr  IXPLKKEIITtMd  ACriOK  FLAKS  FOR  IMPROVIKO 
tHS  ODALirV  or  SPARK  PARIS 
(PROJECT  HO,  20F*H)D53) 


X.  rinding  A.  Accountability  in  laplMwnting  Aotinn  Pians 

DOO  Conponant  lAOlsmantlng  aotiDa  plans  did  not  Includo  th>  bssla  for 
holding  KAnagwunt  officinla  aoeountablo  for  aohlaving  gnality  a*Burancn 
program  rMulta  and  for  coatinuoualy  improving  tho  goality  of  aparo  and 
rapair  parta«  Xaplmaanting  action  plans  laokmd  accxnintability  baoauaa  tha  DOD 
CoaDonSittf  did  not  matablUh  dafinits  parformancm  nwuras  to  aaaaaa  program 
result  a  and  did  not  S*t  raaliaticr  tima-phas#d,  long-rangs  miiastonsa.  In 
additiont  the  DOO  Oomponants  did  not  davalop  pcooaduzaa  for  obtaining 
faadbaclc  from  tha  uaars  of  Spars  and  rapair  parts  rsgardlim  tha  adsgoacy  of 
ths  sotion  plansi  sad  ths  Army,  Mary,  and  ths  Dafaoaa  Logistics  Agsnoy  (PXA> 
did  not  asolgn  nor  raassign  rstponalbilitiss  for  implamanting  ths  action 
plana.  Aa  a  rssaltr  tha  DOO  Oomponants  could  not  aas  ths  iMplamsnting  action 
plans  ss  a  managanant  tool  for  maasuring  tha  affsctiTSnsaa  of  quality  program 
rssults. 

Ths  laolc  of  rsaponsibilityj  ovaratght,  ersditabls  parformancs  iiMaurM, 
milsatonan,  and  aecountabiXlty  in  ths  DOO  CoiBponsnt  Implnmsntiag  action  plans 
conatitutsd  matsrial  Intsmal  eonbrol  wsaknssaaa. 

DO  not  oonenr.  Ihs  DOO  Action  Flan  for  Continuously  Xaq^oving  tha 
quality  of  Spars  and  Rapair  Sarta  was  a  ahort^-ranga,  lamodlats  raaponsa  to 
DOD  xa  Audit  Raport  Mo.  SS-Oii.  Xt  was  not  intsodsd  to  bs  a  Icmg-rangs 
planning  or  managsmsnt  docnimaat.  This  fact  was  acknowlsdgsd  on  pags  nlna  of 
ths  draft  audit  report  where  it  states  the  "initiativoe  for  Ingilmaenting  the 
36  objectivee  in  tbs  SOO  Action  FIsn  are  primarily  short-emnga  aaotions  and  do 
not  rsprssent  a  long-rangs  plan  to  oontlnoously  laprovs  ths  quality  of  spars 
and  impair  parte.  The  DOD  oompoAenb  implmnentlng  action  plane  wore  one-tlms 
rseponaaa  that  refleotsd  tha  bOD  plan  and  did  not  daeoriba  tina>phaaad, 
Icmg-rangs  activitias  and  Inltiativss  for  mach  objective.*  A  number  of 
objectives  and  initiatlvss  in  ths  DOD  Action  Flan  were  not  applicable  to 
Mavy,  as  thsy  wars  prlaarily  dssignsd  to  address  dla  areas  of  rsaponeibllity. 
For  these  reasons,  tha  Kavy  Implementation  Flan  was  dssiansd  to  portray 
sbortorangs  zseponsss  to  tte  llmitsd  aecps  of  ths  DOD  initiatives  and,  whars 
warranted,  supp^  for  dla  rseponslbls  items. 

The  Havy  implamaatatioo  Flsii  was  dsaigoad  to  ba  only  one  of  tha  many 
tools  uead  by  Kavy  to  effect  impeovaawnts  to  the  quality  of  speraa  and  repair 
parts.  Other  tool!  inoludsd  tbs  use  of  Total  Quality  xanagsnsnt  (TQK) 
techniguSB,  such  as  ths  creation  of  Quality  Nanagansnt  Boarda  (QKBs)  (s.g.. 
Quality  ZXaficisney  Report  QKB,  Supply  and  Platrlbotion  0KD,  Training  QMS, 
etc.)  and  Process  hot  Lon  Taw  (PATs>  to  tsokls  critical  ssgrnsnta  of  quality 
needs  and  problem  areas  •  rrograms  wars  craatad  as  a  result  of  now  direotion 
end  changing  philosophy  on  the  part  of  Defeaae  Acquisition.  This  was 
espeoialXy  ovidont  in  the  ereation  of  the  Red,  Vollcw,  Oraan  Frogrem  to  judga 
the  past  performanos  of  oontractors  and  use  the  results  to  add  the  estiaatod 
coet  eseociated  with  inorsaaed  tsiting  to  the  oontract  bids  of  bid 
performers.  In  some  canoe,  new  programs  vmrm  created  to  tehe  advutage  of 
changing  technology  that  provided  new  oapabilitiee,  such  as  tha  electronic 
tranimiaeLon  of  Quality  Deficiency  Roports  (QDRs}*  Ttie  Kavy  has  used  a 
multi-pronged  approach  to  bring  about  improvemente  In  quality. 
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tbm  Audit  ropuct  incoxYAetiy  Atmtus  Ut«t  thu  Mat/  laplMMntstlon  Flan 
ha*  bu«n  iip^t«d  Ainou  2990*  Zt  was  updatad  in  2991  for  ujui  dueitig  tha 
SUMta  dubcoaolttaa  hatringa  cooduetad  by  danator  John  alaim«  A  naw  n]^ata 
wa  initiatad  in  Pabmary  1993  and  aubaittad  to  OSD  In  Daoaabar  1993.  Thla 
iqpdata  incorporataa  tlia  nan  prograu  azui  iiUtlativas  davalopad  aiuca  tha  Xaat 
uiidata  in  1992. 

ma  abort  tarn  baaia  «f  tba  dod  Action  Plan,  and  tha  raquiraaant  that 
Mraio#  iBplaiDantatlcn  plans  addraaa  only  tha  Itam  eontatnad  in  ttia  DOO 
Aotlon  Plan,  kaTo  praoLudad  tha  uaa  of  Utm  Mavy  laplaaaatatioo  Plan  as  a 
aina  joaant  docuaant.  To  hascoa  a  yrlabla  tool  for  Mnagaaant  af  tha  Quality 
Pzograa,  jeaatriotiona  on  tha  eontant  of  tba  Vavy  Plan  Miit  ha  allainatad, 
tharaby  allowing  tha  plan  to  undargo  bom  algnif leant  ohtngua.  Objactiywa 
auat  ba  zawrittan  to  ailiSraaa  problaa  aoLutiona  that  ara  of  priaary  hanaflt  to 
aavy#  rathae  than  alaatad  toward  DXA  intaraat  araaa,  such  aa  tba  onaa  found 
la  tha  currant  dod  AOtian  Plan.  Kaallatle  aativltiaa  nuat  ba  darivad  that 
can  ba  aoblavad  by  Vary.  Baaad  on  thoaa  actirltlaa,  Vavy  can  davalop  long 
rang#  nilaatocaa  and  daoiaion  points.  Thla  nhould  ba  tKa  focua  of  futura 
Navy  acTtiona  to  iavrova  tha  quality  of  acqulaition  Itaaa,  rathar  than  tlw 
ourrez^:  DOO  Action  Plan  which  contaiiui  only  a  faw  uaabla  aetlYltlaa  and 
objactlvaa. 

Navy  doaa  not  oonour  with  tha  atataoMinta  in  tha  audit  raport  that  raCar 
to  material  intamai  control  waatnassaa,  Tha  aalatanoa  of  major  prograaa  to 
lipp):ova  tba  quality  Of  aparaa  and  repair  parta,  auch  aa  tha  autocoatina  of 
information  eonaamlAg  quality  <POASP  ayataa^i  uaa  of  dafioianoy  data  to 
aralaata  vandora  4Rad,  fallow^  Oraaa  Program)  |  and  tha  oraation  of  Dofactiva 
hatarial  Aaaiat  Zaama  <I>HAT)  damonatrata  IfaYy's  intent  to  be  e  leader  In  thla 
effort.  sUkoa  the  DOO  Action  Plaa  waa  not  intaodad  to  ba  a  lon^ranga 
planning  docnimant,  and  aa  tha  Navy  Inplaaentation  Plan  waa  not  intandad  to  ba 
an  all  encodq>«aalnq  eanmganant  docuoant,  oonoloaiona  aa  to  the  strength  or 
wealuMsa  of  internal  control  cannot  be  drawn  baaad  on  whether  or  not  tha 
plan  was  updaUkl. 


Wa  ramamand  that  tha  Aaaivtant  Sacratariaa  of  tha  Amqr  and  Navy 
(Naaaacoh,  Davalopaent  and  Acqulaition),  tha  Aaiiatant  Saor^ary  of  tha  Air 
yorca  (AoquiaitloD) ,  and  the  olai 

1.  Mginolng  In  fiaoal  yaar  1994,  aattbllah  polioioa  to  ralaaua 
updatad  plana  for  implaaenting  tha  DOO  Action  Plan  for  ContinuOualy 
iBpzoving  the  Quality  of  Spare  and  lUpalr  Parta  avery  two  yeara  to  track 
quality  iaprovanant  accompli  a  hnant  a. 

POM  Gf—ment 

concur.  Navy  already  baa  auhoittad  an  updata  to  tha  Navy 
Zaplamantation  Plan  in  Daoaabar  2993.  Putura  aubmlaaiona,  Kowavar,  abould 
be  baaad  on  a  ravlaad  Navy  Plan  which  reflaota  only  Navy  iataraat  itama. 

Mm  DOO  Action  Plan  should  ba  revlaad  or  dropped  ui  favor  Of  general 
ouidanee  to  allow  tha  sarvioea  to  davalop  a  mora  naaninqful  aat  of 
obJactlTee  and  aotivLtiaa.  A  raquiremant  for  a  two  year  update  will  not 
inaraaaa  tha  effaetivenaaa  of  a  plan  that  la  intended  an  a  aanagamant  tool. 

A  more  eff active  ragulraaant  is  to  update  tha  Navy  Plan  when  naoaaaitatad  by 
aiynif leant  ohanqaa.  Zn  this  fashion,  tha  plan  would  be  a  living  doouniant 
that  raflaota  tha  ourrant  atataa  of  Navy  afforta  at  all  tiaae,  rathar  than 
once  avary  two  yaara.  Navy  will  aatabliah  policy  to  update  the  Navy  Aertion 
Plan  aa  changes  occur.  The  police-will  ba  contalnad  in  tha  new  plan  which 
ia  expected  to  ba  publiahed  In  Deoaebar  1994. 
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l«t«blish  r«gulttionp  for  Iwpl— ntiiKI  UnitMl  Btafcas  Codm  <nflC) » 
tltls  10.  Mafeioa  2383,  to  nquiro  tbmt  contitaetor*  •applying  eritioal 
aircraft  and  ahip  porta  Mart  appropriatt  gualifioation  and  contractual 
gumlLty  roquirononta . 

fvwiwfth 

Oafor  to  thn  Vndor  Merotary  of  Mfanoo  tor  Aoquialtioa.  tfavy  will 
•upport  offorta  to  otandardLoo  Y*ndcur  rating  •y«taaa.  Tho  Hod,  Tallow#  croon 
frogroa  darolopod  by  Ifavy  would  bo  Oi)  aacallaiiiC  oondidata  for  adoption  aa  a 
•tandord  DOO  ayaton,  OdD  haa  indlcatad  It  ia  awaiting  tho  OutooMO  of 
oongraaalotml  doliborationa  on  propoood  logialatlon  S.IBST#  introducrad  by 
senator  Olonn  on  26  Octobor  1S03#  which  will  repeal  ssc#  title  10#  eeebion 
2383*  Mavy  mipporta  08D  leoderablp  in  this  natter# 

a.  wo  reoaoMod  that  the  hseietont  deoretarieo  of  the  Amy  and  Vavy 
CReaeorch,  Developnant  and  AoqaiaitiOA)f  the  Aeilitont  seoretory  of  the  Air 
force  <Acquialtlaa),  and  the  Dixecteri  DLA  update  their  inplonauiting  action 
plana  to  abow  the  cmrrant  or  planned  ecilona  toi 

a.  Naintein  teeiuiieal  diti  paoktgee  and  eohe  fchm  available#  adequate 
end  accurate  ee  in  initiative  tor  objective  2#  ensure  technical  date  ore 
available#  adequate,  end  accurate  for  uoe  in  aoquirlJig  quality  parte. 

b#  Ooeply  with  the  requiroMnte  oC  Office  of  Podarol  Procurament  Fclloy 
Letter  so.  91~3#  *Aaporting  Nonconforming  Produote,*  to  perfcioipata  in  the 
aovernawnt-Xnduetry  Date  BxchOAge  Progmoi  oa  on  initiative  for  objective  23, 
laprove  the  euatomor  complaint  eyatan# 

e.  Support  the  developeent,  pLennnd  doploynant  and  Inplomentatloa  of  the 
DOO>wida  Daficienoy  Bopocting  Syotae  (DBS)  oe  an  Initiative  for  objective  23# 
ieprove  the  euatooiar  complaint  syetem* 

d*  Beduoe  the  jMMd>ar  of  forme  ueed  to  raport  Aonoonfcrmanoee,  and 
ahoAdordiao  tho  forme  end  the  uoe  of  the  forme  ee  iAitlotivee  for  objaotive 
23,  ieprove  the  cuatomur  oomplaint  ayatam. 

e«  Provide  the  training  needed  to  verify  that  the  Product  Quality 
DefioLenoy  Boporte  Program  i*  ueod  effeotivaly  ae  on  initiative  for 

objective  23,  iinprove  the  ouatomar  coa^alnt  eyetem# 


Concur.  Navy  eubalttod  an  updated  Inplenentation  Plan  to  OSD  in  Peceeber 
1993,  containing  current  actiooe  and  Initiativee  not  included  In  the  last 
update  eubeitted  in  1991.  Thie  update  eddreeeedi 

e*  Xn  reeponee  to  objective  3  of  the  OOD  Action  Plen#  POD 
publlehed  DOD  5010. 13K  (May  1993),  •'Proeeducee  for  the  Acquieitlon  end 
Hanegement  of  reohnioel  Date,*  which  previdee  a  uniform  epproeoh  to  enquiring 
and  managing  data.  In  eddlticn,  the  ASM  (ROSA)  publlehed  the  "Acguleitlon 
Planning  Qaida-  In  April  1992  which  Mrvea  as  the  Navy's  guide  for  teohnioal 
data  acquieition.  NAVSOP  iesued  publloatlon  S94#  -p.S.  Navy  Procureawnt 
Toehnical  iMtta  Kandbcxik#"  in  Septmnber  1992,  which  providee  guidoncm  for  the 
acquieition  of  tmcdmical  data  and  technloal  data  pockagee  auitoble  to  procure 
or  raprocarm  on  item.  To  identify  the  locetioa  of  technloal  data  lA  order  to 
acquire  qoellty  parts,  Nivy  hee  loaded  over  19  Bdlliem  data  iteme  into  the 
Military  Inginomring  Data  Aeeet  Locator  Syetem  (MEDALS)  detobaao.  rinelly, 
current  Navy  breakout  procedures  ensure  adequatm  end  complote  technical  data 
pmokagse  ore  available  prior  to  eocBpstitive  prooureipent  of  spore  ports. 

b.  HAVSOPXNSr  5200.  26b,  •Ooverzment-Xndustry  Dots  XKOhongo  Program 
(GIOSP),*  signed  10  Novatsfaer  1993,  ieplsiaenti  policy#  asaians 
rssponsibilities,  and  provides  uniform  proosdurme  for  participation  in  the 
OZPBP  program.  eiPir  inCormatlon  la  collected  in  euamary  form  in  the  Hevy'e 
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Product  Mfieianoy  lUportiDg  and  ■▼•luAtloii  Program  (PORKP).  Onc«  in  PDRBP, 
this  infonaatlon  1»  AYillatolm  lor  nmm  in  tbo  Kavy'n  Badr  yallow«  groan  varusor 
rating  •yatott*  fllailarly,  aonn  quality  problOM  idaatlfiad  by  tba  Havy  and 
doauaaatadl  on  PBREP  VallotiA#  «ra  of  intaraat  to  i^ivmba  eompanlaa,  and  ara 
proridad  for  inolualon  in  tba  OZDBP  ayatarn^  At  praaant,  tba  maohaaiatt  for 
tbia  intarchaaga  of  information  la  manualj  bowavaTf  an  alaotronio  Lntarfac* 
batwaaa  tha  ttM>  ayatna  la  ondar  daralnpmant  and  alioald  b»  fsoapLatod  by 
January  1994.  With  thia  intarfacar  Mavy  will  ba  abla  to  download  aalaotad 
GXDXP  vaporta  alaecronloallyr  than  load  thaa  dlractly  lato  KmSP. 

o.  000  will  ataadardlaa  dafioiaiiey  raportiag  into  a  aiagla  ooaputar 
program  eallad  tha  1>1UI»  Mary  fully  anpperta  and  la  aotivaly  partioipabing  In 
thia  affort*  Tha  Havy'a  Daficlancy  lap^  Log  <DlEL0a)  baa  baan  aalactad  by 
tha  Joint  togUtica  Ayatama  Cantar  <JLAC)  oiractor  of  Matarial  Managomant  aa 
tte  prototypa  for  tha  MUf. 

d»  Maty  policy  on  cpiality  dafloianoy  raporting  baa  baan  updatad. 
Tneludad  la  policy  guidanoa  on  anhancing  tba  vgPK  raporting  and  faedback 
ayataa*  lawy  FAfa  ara  aotivaly  Inraatigating  «Mya  to  Ingprowa  tha  FQDR 
ayatam.  Soma  of  tha  improvamantl  that  hava  aizaady  baan  roallxad  arat 
alaotronio  proeastlng  of  FQDXrf  oantraliratlon  of  wa  managamantr  and 
autoaatad  aecaanlng  during  racalpt  proetaring  for  all  naw  raoaipta  and 
matarial  raturna.  All  of  tbara  initUtivaa  will  aaaiat  In  atandardising  and 
raduolng  tha  ni^iar  of  forma  uaad  to  roport  noAConfocmanoao-  Anothar 
initiativa  that  will  promotw  grwatar  afficiancy  la  tha  Dafaetira  icatarial 
Aaaiat  Tam  (nxAT) «  two  DKATa  havm  baaa  oraatad  -  ona  in  dan  Diago  and  tha 
othar  in  JackaooTilla,  Thay  ara  watarfront  oparatlonn  aatafailahad  to  aaaiat 
fXaat  and  indqatrial  ouatoiMra  with  raporting  and  managing  dafaotiva 
matarial*  Tbay  parfom  a  aariaty  of  fiiActiona  on  bahaXf  of  tba  ouatamart 
proTida  onaita  aaaiatanea  with  filing  FgpRaf  aubalt  WlU  alaotronically  to 
tba  appropriata  aoraanlng  pointi  track  PQPR«  to  anaura  raportad  dafaota  ara 
Invaatlgatad,  zaaulta  ara  providad  to  tha  fqdr  originator r  and  csafactiva 
matarial  dlapoaition  ina  bract  Inna  ara  proridadi  oonaolldata  aahora  all 
aaaoclatad  dafaotiva  matarial  panding  dlapoaalf  and  anaurm  tba  dafaotiaa 
matarial  la  purgad  in  auch  a  aannar  to  praoiuda  rauaa  within  DOD.  Tha  uaa  of 
a  DK&T  will  iaprora  tba  Quality  of  fOPP  aubaiaalonai  raduca  tha  nuabar  of 
forma  ragnirad  to  idantify,  raport,  and  track  nonoonformanoaai  raduca 
procaaaing  tiaar  raduoa  ouatoaar  %forkload  aaaoclatad  with  dafootlva  matarialj 
and  aliainato  chipboard  atoraga  of  dafactiya  matarial. 

a.  nayy  ecntlnualiy  atrivaa  to  inprova  training  of  paracnnal  in 
oonplating  and  procmmmint  PQPAa.  fha  advant  of  DKATa  Will  provida  additional 
training  to  paracnnal  conplatlng  FgpA  forma  through  ona~oa-ona  aaalatanoa  and 
advioa.  Khan  poanibia,  DHAT  paracnnal  will  coi^lata  tba  forma  for  float  and 
induatrial  unite  f  thua  anaari^  tha  PgDAa  arm  complata  and  corract*  Tha  uaa 
of  DKATa  la  arpa^od  to  graably  improva  tha  ouatemar  complaint  ayatam. 

9.  Ma  racoBuwnd  that  tba  Aaaiatant  Aworobariaa  of  kha  Army  anil  *a«Y 
(Raaaarch,  Dayalopmant  and  AoquiBltlon)|  tha  Aaaiatant  taorotary  of  tha  Air 
roroa  (Aeguiaition),  and  tha  Dlractor«  DLA  ravUa  thalr  implamantlng  action 
plana  toe 


a.  fupport  an  affort  to  idantify  and  daaignata  ona  ayatam  ao  tha 
ataxuSard  SOD  ▼andor  rating  ayatam  aa  part  of  an  additional  objactlva  to  tha 
pro-oontraet  phaaa. 

b.  Daacrlba  tha  aoti<ma  taken  to  aoaply  with  UBC,  titla  10,  aacblon 
3383.  "Procuromant  of  Critical  Aircraft  and  Ship  Parta^*  aa  an  initiativa  for 
objactiya  7,  anaura  all  auppllara  of  apara  parta  and  rapair  parta  moat 
apaciflad  quality  and  tachnioal  roguiramanta . 

c.  Support  dovolopmant  Of  eontractual  policy  proposals  to  obtain 
ralainiraamant  or  raplacamant  for  predueta  acsoaptad  by  tha  oevamaant,  tuit 
latar  found  to  eontaln  patont  da  facta,  aa  aa  initiativa  for  ebiaotiya  a, 
rajact  or  raqaira  corractiona  of  nnnoonforaiAg  aupplLaa. 


Department  of  the  Navy  Comments 


d.  Rmbcmni  nocieonfarniim  product*  idontifiad  on  PQpXfl  front  Dafann*  ffuppLy 

a  atom  inydAtori«i|  notify  oontractora  vban  thoir  nonoenfojemlag  produots  ura 
■ooracvd  «ful  ptavlda  9vpimm  af  dafiotanoy  infMaatian  ta 

oenbcactera  ao  tli*  conbraotar  aaii  oorraet  tha  cauaa  of  tba  ^paaliby  eontjfol 
failura^  InfoM  oontractind  officrar*  no  thay  eui  atfcanpt  to  racoap  tba  Tftlua 
of  tba  nonoonfora&ng  ptoduotai  and  doouMAt  tha  viality  aaauranaa  daaiaiona 
to  raquoat  or  net  raquaat  laboratory  taitina  aaadad  te  auppert  fQBna  aa 
initiativaa  for  objactiTa  23,  loproya  tha  euatoaar  eoaplaint  myataoi. 

a.  Davalop  strata glaa  for  coat  affaotlaaly  tarpatisig  quality 
aaauruiea  laboratory  taatin^  to  LdantLfy  auaoaptibl#  product  linaa  and 
peoblaa  eontraetorar  and  to  randoaly  taat  tha  product ■  auppliod  by  problao 
auppllara  at  avary  national  invantory  control  point  (ICT)  aa  an  added 
objactiva  for  tba  faadbaok  intalLioaaoa  phaaa» 

f«  Kraluata  tHa  adequacy  of  quality  aaauranoa  laboratory  teat  plana  aa 
an  initiatlra  for  objactiva  23,  anbanoa  tha  use  of  dgo  and  indapendant 
laboratory  taat  eapabllitiea. 

Doa  Conmairt; 

Oonouc*  Pavy  eubeittad  an  updatad  InplaiMMntation  Plan  in  Oaoaobar  1993 
cxuitalninq  currant  inltiatliraa  and  proqrwa  not  inoludad  In  tha  laat  npdata 
aubaittad  in  1991.  Tba  following  coaaiinta  are  offered  la  raeponaa  to 
BpaolClo  rern—ewdat ions  contained  in  the  audit  reporti 

a.  Kavy  fully  aupporta  any  effort  by  OOP  to  Ldantify  and  daalqiutn  a 
atandard  render  rating  ayataai*  Vary'*  had,  yailow,  Oraen  Frooraii  could 
aff  actively  parforn  aa  a  DO]>^lda  aye  tea, 

b.  ahould  Ccmgraaa  not  pias  tha  Laglalation  introduced  by  senator  aienn 
on  36  October  1993,  (S.IBBI),  Savy  will  aupport  any  action  taben  fay  OSD  to 
comply  with  oao,  title  10,  eaction  2363,  "Procairaaent  of  Critical  AiroraCt 
and  Ship  Parts.*  Open  raoaipt  of  diroction  by  OOP,  havy  will  develop 
specific  iavleoenfcl^  ioatructlona. 

c.  havy  will  aupport  any  action  talcan  by  060  to  develop  contractual 
policy  proposals  to  obtain  ralaburaamsnt  or  replacaiiaat  for  produota  aocMpted 
by  the  QdrarMMnt,  but  later  found  to  have  patent  defects.  It  is  not 
poeeibla  for  havy  to  unilaterally  change  current  Pedermi  Acquieition 
negulatioa/  Defense  Pederal  Aoquieition  Segulafeioa  SupplaMnt  inatruoticMie  to 
reflect  the  valid  use  of  these  proposed  patent  defect  cliuaaa  In  Navy 
ctmtracta.  Thia  auat  be  addressed  by  OSD*  havy  has  baen  able  to  nagcTtlata 
failnre  free  warranties  on  two  eontraeta  -  a  ooapetitive  puxebaaa  of  tha 
ALQ-99  tlaotronlc  CoantaraaaBuraa  haoaivar  and  tha  Qoarta  hate  Sensor  for  tha 
Uarriac.  In  tba  case  of  the  KLCl-99,  tha  contractual  claua*  apacif  ically 
atatad  tha  itama  "would  be  free  freo  dafaote  in  aatarlaX  and  worloMnahlp,  and 
confocsi  with  all  the  reqwirssante  of  tha  oontract  for  a  pericki  <»f  SO  months 
regardless  of  govarziBisnt  ivapaction  and  aocaptanoa.*  Olauaaa  Such  as  these 
are  not  appropriata  for  all  aystsos,  Savy  la  daraloping  a  notice  on 
wnrrantiaa  which  ahould  be  released  in  January  1994.  Mavy  has  provided 
oopiaa  of  these  two  warranty  elauaaa  to  other  Barricas/DIA  for  poaaible  naa. 

d.  Upon  racaipt  of  a  POPS,  savy  eonduota  an  invaatigation  to 
aubatantiata  tha  nonconfomanca  and  dataralna  raaponeibility.  Doth 
govariwiant  and  oonmerclal  faoilltiaa  are  used  to  parfora  required  testa  to 
aupport  tba  PQOIt^  Mooconforaing  produota  era  ramovad  fcoai  tha  ayataa  and 
purged  to  inaure  they  do  not  return  to  tha  DOD  aupply  ayatatt.  Where  it  haa 
bean  datenalxwKl  that  tha  vender  ia  raapanslbls,  tba  eontraoting  offioars  are 
notified  ao  they  can  atteept  te  effect  repair,  replaoeMant,  or 
ralinburaaaaat.  Tha  recant  update  to  Savy*a  policy  on  quality  defiolancy  and 
reporting  provides  for  nnxe  apacif iolty  In  assigning  causa  in  PQDR  eloaing 
actions.  Thia  ia  axpaotad  to  eahanea  capabilities  to  dataraine  vendor 
liability.  All  of  the  above  procadures  are  atandard  within  Mavy  and  have 
bean  proven  affective. 
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••  100  p«cc«nt  tmmtUiq  of  oil  LovaX  l  MucloftTr 

MS«ty«  Mul  nmtmtY  of  Flight  Favy  XCFa  ua*  IndapwHSant;  taatUtg  oa  a  vary 

limlt.ad  baaia  baoanaa  of  Maourca  oonotrainta*  tha  pregraai  at  Mavy  ChLpa  Farta 
GoatfoX  Oaatar  (iFOC)  ia  cortOrttly  lljaitad  to  tMting  rapairabla  ootponanta  from 
aajor  iMapoa  ayataM.  TKa  pfogrM  at  tha  Kaval  hviAtloa  supply  Of  flea  <XfiO) 
taata  oalr  cortauaahlaa,  but  viU  ineluSa  rapairabla  ia  tha  futui^.  Mavy  eraatad 
tha  OiaaaX  Bogina  Faria  Xaprovanant  tcograa  to  iaprova  tha  guality  of  diaaai 
angina  apara  and  tapalr  porta  pcovldad  to  tha  Claat.  Inapaetlotia  of  tuapact 
parta  flSteatlfiod  ualog  FOPS#  Couaality  Baporting  iOaSKSF),  and  SB  data)  in 
Mvy  and  bOO  imrantortaa  ara  aada^  with  nonoonfoniing  pacta  puegod  fcoa  tho 
oup^y  ayatoai.  May  plana  to  aapand  thin  taating  paograa  to  includa  gaa 
turbiaa  aagliiaa#  pui^»  and  air  eonditieiting  unlta.  Hbao  raaonreaa  parmit# 
Jlavy  vill  aapand  tha  taatlng  pirogra*  to  othar  critioal  Ltwmm,  both  in  atoeX 
and  prior  to  plaoing  ia  Invotory,  Savy  will  uaa  OU  and  othar  POD  taabing 
laboratoriaa  for  thla  affort*  PLA  baa  agcaad  to  allow  Navy  to  uaa  aliawinto 
of  thalr  lab  tatting  prograst  to  laeluda  contract  vahlclaa,  to  taat  Wavy 
aaaata*  Wavy  haa  arrangad  to  uaa  taat  raaulta  fvon  tha  PtA  Syatan  for 
JMalyaia  af  Lab  Taat  Waaalta  databaaa  and  tha  air  Faroa  OonfonoanGa 
Varifieatlon  progran  to  Ldantlfy  pctantlal  problan  amaa  or  eontractora  foe 
invaatigatioa.  la  thla  way,  a  aora  aoat  wffactiva  aaana  for  tar  gating  taat 
itana  can  ba  aavloyad, 

f.  Savy  La  avaluatlng  tha  adaquacy  of  quality  aaouvanca  laboratory  taat 
plana.  Maatinga  with  aPOC  and  MO  bogan  In  Wovawhar  IW  and  will  eontlnua. 

4.  NO  raQomnand  that  tha  Aaalatant  sacratariaa  of  tha  Any  and  Wavy 
fRBBMrch,  Davalopnant  and  Acguiaitloni ,  and  tha  Aaaiatant  Aaoratary  of  tha 
air  Foroa  (Aoquiaitloo)  raviaa  tha  Military  bapartaant  laplawtnting  action 
plana  by  adding  an  inltiativa  to  taat  product  linaa  atorod  in  dapot 
Invantoriaa  nunpactad  of  ooataiiLLng  noneoAfomiag  product  a  aa  part  of 
objactiva  it,  idantify  and  purge  nonoonforodng  natwrial  from  tha  wboiaaala 
laval  Invantory. 


Concur.  Mvy  haa  aubaittad  an  updated  Xaplaoantation  Flan  In  Daombar 
1993  containing  initiativaa  and  programa  not  inoiudad  in  tha  1991  update. 

Ona  of  tha  Itaaa  ditouaaad  ia  tha  now  updated  plan  dealt  with  the  Diaaai 
Ingiu  Parte  XaprovaBwnt  Frograa#  daalgiMd  to  lag>rove  tha  quality  of  diaaol 
•ngioa  apara  and  mpair  parta.  Inapactiona  of  auapaat  parta  lidantlfiad 
uaing  FQDR,  C&tRfP,  and  IN  data)  in  Navy  and  DOD  invantoriaa  ara  aada.  Wavy 
plana  to  expand  thla  taating  program  to  includa  gaa  turbina  anglnaa,  puapa, 
and  air  conditioning  unita. 

S.  Ha  raoowinand  that  tha  Director,  DLA,  raviaa  tha  PLA  Action  Flan  to  adds 

a.  An  objactiva  to  davalop  tha  Contractor  Profile  ayataw  in  tha 
praaonkraot  phaaa. 

b.  An  inltiativa  to  maaaura  and  daacribe  tha  prograaa  of  all  DOO 
oootraetora  ia  tha  Za-Plant  Quality  Svaluation  Frogran  uiuUur  objactiva  14, 
eaaaure  affactlvanaae  of  in-^ant  Oovaninant  contract  adalniatration  and 
cootraetor  perfopaanca. 

o.  An  fdijactiva  to  ia^lanant  tho  coeaarcial  quality  abandarda  that  ara 
daacribod  in  tha  Xntamaticnal  OrganLaation  for  Standardisation  (ISO)  9000 
•vrlaa  and  aquivalant  Amarioan  Watlonal  standarda  Znatltuta-Attarlcan  Soclaty 
for  Quality  Control  (ANSZ/ASQC  g9a)  Quality  eyatam  aMrlna. 

d.  An  inltiativa  to  davalop  training  for  Dafanee  CSontract  Manageoisat 
Coeauind  quality  aaauranoa  repraaentativei  on  how  to  wvaluata  tha  160  9000/Q9a 
coaiBarcinl  quality  ay  at  ana  uiuSar  objeativa  13,  updata  in-plant  oovarnmant 
quality  aaauranca  procxKhiraa  to  provida  Cknractiannt  quality  aaauranca 
rapreaentativaa  floMlbility  to  tailor  ovoraight. 
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An  iAltimtlwm  to  Moanitro  tho  nunbnn  of  wnlvoro  and  dovlationn  Mid 
tho  nuMbMT  of  MainrUl.  Unfimt  Board  action*  that  am  approved  and  Inoluda 
that  inf  omatlOA  in  tha  Qualitj  BffsotlTaiMaa  BanaJjig  Tachnivin  nndar 
objaDtlva  10,  raduca  ooatraofcor  natarlal  raalaa  board  not  Iona  and  raqaaata 
for  walvar*  or  davlatlona. 

f  •  An  objaotiya  to  varify  that  ixiapactioil  pjcooaduroa  for  rapackagad 
prodUQta  ara  appllod  ao  that  damagad  product*  ana  not  aant  out  and  that  all 
nraaaary  LaforMtioa  La  iaeludad  on  ttia  paokaya  label  aa  part  of  the  d^pot 
{aupply  mmDMgwmmiAi  phaao« 

non  ffwTwant 

Defer  to  DLA. 
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16FCB  1934 


memorandum  rOR  ASSISITAWT  IN6RKCTOK  GENERAL  POR  AUDITING 
OFFICE  OF  TUE  INSPECTOR  GENERAL 
OBFAUTMEhT  OE  DEFENSE 

8DBJEX;Ts  Repoct  on  DOD  Conponent  Implementing  Action  plans  Cor 
inproving  the  Quality  of  Spare  Parts  (Project  No, 
2CF-0053)  -  INFORMATION  MEhOR/iNDUM 

This  Is  In  reply  to  your  memorandum  reguoating  the  Assistant 
Secretary  of  the  Air  Force  (Financial  Management  and  Comptroller) 
to  provide  Air  Force  comments  on  subject  report. 


Our  coinicents  aco  attached. 


Attachuent : 

Air  Force  comments 
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AIR  FORCE  COMMENTS  ON  DOD{IC)  REPORT 
OH 

DOD  COMPONENT  IMPLEMENTING  ACTION  PLANS  FOR  IMPROVING 
THE  QUALITY  OF  SPARE  PARTS  (PROJECT  NO.  2CF-0053) 


INTERNAL  CONTROLS 

I.  Thft  DOD  (IC)  rQport  on  pA9«  4  sunoiarisnd  tfan  servioea 
and  DLA  aetiona  taken  regarding  eatabliahing  internal  oontrola 
pertaining  to  identifying  offloee  of  prinary  roaponaibillty 
(OFRa}»  revision  of  tbe  component  plans  which  would  Include 
Measures  to  assess  performance,  and  establishing  realistic  time* 
phased  mllestonas  for  accomplishment*  The  two  Internal  Control 
paragraphs  also  are  closely  related  to  Finding  A  discussion  on. 
pages  8  through  11.  The  Internal  Controls  paragraphs  follow: 

* Internal  Controls  Reviewed.  Ke  attempted  to  identify 
Internal  controls  within  the  dod  Coaponants  for  assuring  that 
ijnpleaentiog  action  plans  were  maintained  to  reflect  current 
objectives f  Initiatives,  performance  measures#  and  milestones  to 
continuously  improve  the  quality  of  spare  and  repair  parts. 

Also#  we  attempted  to  identify  offices  of  primary  responsibility 
for  each  objective  to  determine  the  adequacy  of  oversight  and 
responsibility.  The  DOD  Components  had  no  internal  controls  in 
their  Internal  nanageaent  control  programs  to  address  whether 
management  officials  revised  and  updated  the  implementing  action 
plans . 


"Internal  Control  Weaknesses  Identified.  The  audit 
identified  materiel  internal  control  weaknesses  as  defined  by 
Public  Lav  97-255,  Office  of  Management  and  Budget  Circular  A- 
123,  and  DOD  Directive  5010.38.  The  DOD  Components  did  not 
revise  or  update  their  implementing  action  plans  to  verify  that 
the  action  plana  included  definite  performance  measures  to  assess 
program  results  and  realistic  time-phaeod,  long-range  milestones 
for  the  actions  needed  to  continuously  improve  the  quality  of 
spare  and  repair  parts." 

2.  Component  comments  on  internal  controls  were  requested 
in  your  17  November  1993  Memorandum  which  forwarded  the  report  to 
the  services,  DLA,  and  USD. 

MANAGEMENT  COHHSNTS;  The  Air  Force  partially  concurs. 

3.  The  following  summarizes  the  Air  Force  position 
regarding  compliance  with  the  USD  plan  and  internal  controls. 
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Pag*  3  ot  your  report  etete*  tbat  *The  prittary  audit  objective 
waa  to  evaluate  th*  dod  Component  plana  Cor  implementing  tb*  oon 
Action  Plan”,  it  also  stated  that  you  would  examine  internal 
controls  foe  verifying  performance. 

a.  The  DOD  plan  outlined  26  "objectives*  ana  their 
related  41  "activities^  or  sub-task*.  The  Air  Force  planj  which 
was  forwarded  to  the  Under  Seoretary  of  Defense  (Acgulel tion)  on 
11  June  1990#  meticulously  followed  the  contents  of  the  DOD  plan. 
This  is  readily  diseernable  by  placing  the  two  plans  side  by  side 
and  comparing  the  "objectiveg"  and  "activities"  of  each.  It  is 
our  position  that  the  Air  Force  plan  implemented  the  dod  plan  and 
hence  ha*  net  or  exceeded  your  implementation  criteria. 

b.  As  it  pertains  to  internal  controls/  the  DOD  plan 
did  not  contain  a  raguirement  for  instituting  internal  nanagement 
controls  to  measure  performance!  howavax/  how  the  Air  Force 
measured  performance  is  dlacussad  in  detail  In  paragraphs  4 
through  7  below. 


(1) «  It  is  the  our  position  that  improvement  of 
the  quality  of  Air  Force  spares  and  repair  parts  In  the  DOD 
supply  system  was  the  responsibility  of  the  commanders  of  Air 
Force  Logistics  Command  (aflC)  and  Air  Force  Systems  Command 
(AFSC) •  These  commands  have  been  consol Ida ted  into  the  Air  Force 
Materiel  Cofunand  (AFKC) . 

(2) .  Further/  in  and  of  itself «  the  AFHC  plan 
should  not  be  a  compliance  document  listing  every  aspect  of  the 
acquisition  process  that  could  be  deemed  a  means  of  assuring 
total  quality.  It  is  only  one  of  many  tools  used  by  the 
commander  to  assure  that  the  Air  Force  obtains  quality  spara 
parts.  For  exampls/  Air  Force  Materiel  Comniand  (AFMC)  has  a 
Product  Inprovement  Working  Croup.  It  is  a  program  that  taama 
buyers  with  the  users  to  explore  various  methods  of  improving  the 
quality  of  systems  and  spare  parts. 

o.  Based  on  the  above/  we  recommend  that  quality 
improvement  verification  be  made  a  materiel  commanders ' 
initiative  rather  than  placing  it  in  the  plans  of  the  components 
as  an  internal  control  check-list  item*  Tba  reasons  for  this 
recoionandation  are  that* 

(I)  •  The  plans  are  only  one  means  of  attacking 
the  problem  of  non-conf arming  parts. 
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(2) •  Improving  the  quality  o£  apares  and  repaic 
parts  la  tiia  rasponfilbllity  of  the  materiel  commanders.  The  act 
of  placing  internal  controls  for  verifying  product  improvement  in 
the  plan  will  not  ensure  such  action.  Quality  improvement  can 
only  result  from  the  culmination  of  many  actions,  all  of  which 
are  dependent  ux>on  the  actions  taken  by  the  caaaanders  concerned • 

4.  The  following  provides  detailed  inforsation  supporting 
our  summary  paragraph. 

a.  COMMENTS  HE6AADING  NOT  UPDATING  AND  REVISING  THE 
AFMC  PLAN  -*  PAGE  4  OF  THE  REPORT  (IHTBRKAX,  CONTROL  NEARNESSES 
IDENTIFIED).  While  the  APMC  plan  did  not  specify  dates  for 
revising  and  updating  the  original  June  1990  plan,  it  was  revised 
in  December  1991.  It  is  our  position  that  it  should  be  revised 
as  required  and  not  on  a  schedule  such  as  every  two  years, 
selective  revision  will  make  it  a  "Xiving*  docunent”.  Objectiv.as 
and  "activities*  (sub-set  actions  related  to  the  objectives)  that 
require  revision  will  be  changed ;  however,  those  that  have  not 
changed  will  remain  as  printed.  The  method  of  revision  could  be 
by  complete  republication  of  the  plan  or  by  preparing  page 
changes.  This  would  be  at  the  option  of  AFHC. 

(1) .  The  Mr  Force  will  have  a  plan;  however#  how 
the  plan  will  be  revised  depends  upon  the  new  guidance  that  USD 
is  planning  to  place  in  the  *dOD  Materiel  Management  Regulation 
(DOD  II40.X-R).  The  contents  currently  are  being  discussed  by 
you  and  OSO. 

(2) .  Our  comments  on  your  report  are  predicated 
upon  the  stated  audit  objective  on  page  3  of  the  report  that  you 
would  evaluate  bow  the  components  plans  implemented  the  1>0D 
Action  Plan.  It  is  our  position  that  we  meticulously  followed 
the  guidance  in  the  3  March  199Q  USD  plan*  contained  no 
requirement  for  the  services  and  DLA  to  establish  internal 
controls  for  verifying  performance. 

(3) .  AFMC  planned  to  revise  its  plan  based  upon 
the  consolidation  of  Headquarters  Air  Force  Logistics  Command  and 
Air  Force  Systems  Command;  however,  this  was  placed  on  hold 
pending  the  results  of  this  audit  which  took  place  from  August 
1992  to  June  1993*  He  concurred  with  the  AFHC  decision  to  delay 
the  revision  based  on  three  reasons: 

(a).  Changes  should  not  be  based  on  informal 
discussions  with  auditors.  Ravising  an  objective  and  its 
Initiative  (s)  must  be  staffed  within  Headquarters  AFNC  and  sent 
to  the  Air  Logistics  Centers  (ALCs)  for  implementation.  This 
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involves  changing  detailed  acquisition  prooeduces  throughout  the 
ALCs-  it  can  be  an  extensive  process  which  affects  how  people 
per fora  their  duties*  Because  of  thlsr  changes  must  be  based  on 
firn  requirements. 

(b)  .  Unnecessary  changes  should  be  avoided. 
Changing  an  existing  plan  to  con Corn  to  auditors  comments r  made 
during  the  course  of  the  audits  could  result  in  unnecessary 
changes  if  the  comments  were  not  included  la  the  final  report. 

(c)  .  Any  changes  must  be  based  on  new  OSD 
guidance  that  will  be  given  to  the  services  and  dla  based  on  your 
report  number  91*^091 »  uubjoot  "Nanagemcnt  of  the  DOD  Action  Plan 
for  Improving  the  Quality  of  Spare  Parts” <  dated  29  Apr  93. 

Action  on  this  report  was  addressed  to  USD.  It  is  still  under 
discussion  by  your  two  offices  as  we  indicated  in  paragraph  2 
above • 

b.  COMMENTS  ON  TOUR  STATEMENT  AT  THE  BOTTOM  Or  PAGE  A, 
THAT  THE  COMPONENTS  DID  HOT  SAVE  DEFINITE  PERFOIdCANCE  MEASURES  TO 
ASSESS  RESULTS  AND  010  HOT  HAVE  REALISTIC  TIME  PHASED  MILESTONES 
TO  IMPROVE  QUALITY. 

(1) .  We  believe  that  this  cottnent  possibly  is 
based  on  misinterpreting  the  AFMC  activities  and  milestones.  For 
exaaple«  tbe  OPRs'  actLons,  which  follow  each  activity#  describes 
the  expected  performance  by  indicating  the  milestones  for  each 
activity,  the  status  oC  its  planning#  execution,  and  estimated 
completion  date. 

(2)  «  It  is  the  Air  Force  position  that 
supervisors  responsible  for  the  activity  can  use  the  ”BCtion* 
portions  and  the  miles tones  to  measure  their  progress#  without 
including  a  formal  reporting  requirement  for  each  activity. 
Further,  supervisors  further  up  the  command  chain  can  use  the 
plan  in  the  tame  manner. 

(3)  •  we  believe  that  achieving  progress  on  tbe 
plans  actions  is  the  responsibility  of  the  AFKC  and  ALC 
commanders.  Without  command  interest,  any  plan  to  improve  tbe 
quality  of  items  In  the  DOD  supply  system  is  doomed  to  failure. 
This  is  equally  applicable  to  the  other  services  and  DLA. 

C.  COMMENTS  ON  YOUR  STATEMENT  AT  THE  BOTTOM  OF  PAGE  4# 
THAT  THE  COMPONENTS  HEED  TO  ESTABLISH  ”L0NG<-RANGE  MILESTONES* . 

(1)  •  We  believe  that  this  is  another  area  of 
possible  misinterpretation.  For  example,  our  Activity  4a  states 
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that  '‘Contracting  officers  are  encouraged  to  apply  the  benefits 
of  "beat  value*  contracting  to  the  acquisition  of  spares  and 
rapair  parts*.  This  relates  to  the  "Blue  Bibbon  Contractors* 
(BBC)  and  establishing  the  *Vendor  Rating  System*  {VBS} « 

(2)  •  the  plan  stated  that  the  BRC  "planning*  was 
completer  •esecutlon*  was  on-going,  and  that  “completion*  was  on¬ 
going.  Since  the  "execution*  and  the  *coinpletiQn*  portions  ware 
*on-gotn9''  (open-ended),  ve  considered  that  these  were  long  range 
actions.  Conversely,  “planning"  for  the  BRC  was  complote,  hence 
we  considered  this  to  be  a  short  range  action. 

{3).  Actions  on  the  VKS  havs  two  phases.  Both 
were  described  in  the  “Action"  portion  of  Activity  4a.  Phase  X 
"planning"  was  completed  in  August  1991.  It  was  scheduled  for 
testing  from  October  1992  bo  August  1993.  “Execution*  was 
programmed  to  begin  in  October  1993,  with  “completion*  being  an 
on-going  or  open-ended  and  was  considared  to  be  a  long  range 
action.  Likewise#  Phase  II  "planning*  was  to  begin  in  October 
1994#  "execution*  was  to  begin  In  April  1995#  and  the 
"completion"  date  was  on-going  or  open-ended  and  was  considered 
to  be  a  long  range  action* 

(4) .  Examples  similar  to  the  above  exist 
throughout  the  plan*  Nowhere  in  the  DOD  plan  is  there  any 
statement  that  it  Is  not  a  long  range  document*  Further,  the  Air 
Force  considered  it  to  ba  ■  long  range  document  when  ve  used  it 
as  a  basis  for  developing  our  plan.  We  believe  that  a  plan  that 
waa  written  in  1990  and  has  mllestanes  out  to  1995,  or  that  ace 
OJi-golng,  must  be  considered  a  long  range  document* 

5.  C0MMEKT3  OH  FINDING  "A"  OF  THE  REPORT  -  PAGES  8  -  12* 

MANAGEMENT  COHMENTSs 

The  Air  Force  concurs  with  the  statements  on  page 
8  that  only  minor  plan  revisions  were  made;  however,  the  reasons 
for  this  are  outlined  on  page  3,  paragraph  4a.  we  also  concur 
with  comments  on  page  9  about  transferring  "objectives"  to  DLA* 

We  further  agree  with  the  comnents  about  the  afhC  organixation 
and  the  lack  of  feed-back  on  page  12. 

We  only  partially  concur  with  paragraph  3,  under 
the  title  "Performance  Measures*  on  page  9  that  our  plan  was  a 
one-time  response  and  did  not  describe  tine  phased,  long  range 
activities  Cot  each  objective,  and  the  last  paragraph  on  page  10 
and  11  that  the  Air  Force  had  no  definite  nilestonem  for  IS  of 
its  21  objectives.  These  are  addressed  in  paragraphs  8  and  7 
below. 
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6.  COMHEHTS  ON  PABAGRAPH  3  ON  PACE  9  OF  THE  KSPORT 
REGARDING  THE  COMPONENT  PLANS  BEING  A  ONX-TIME  RESPONSE  TO  THE 
DOO  ACTION  PLAN. 

The  Air  Force  coneldered  the  plan  to  be  a  continuing 
"living  document".  This  Is  evidenced  by  the  June  1990  plan 
having  been  revised  In  Oeceober  1991  and  that  APMC  van  planning  a 
second  revision  until  it  vas  placed  on  hold  pending  the  results 
oC  this  audit  see  the  Air  Force  dlecuaslDn  in  paragraph  4a 
regarding  internal  controls. 

7.  comments  to  the  statement  in  the  last  paragraph  on  page 

10  OF  THE  REPORT^  THAT  "THE  AIR  FORCE  DIO  NOT  ESTABLISH  DEFINITE 
MILESTONES  FOR  18  OF  ITS  21  OBJECTIVES". 

a.  for  each  activity  of  an  objective,  AFKC  assigned 
three  categories  of  jaileatonea  -  one  for  planning  i  one  for 
execution,  and  one  for  completion,  AFMC  did  not  aeaign  a 
calendar  date  to  each  milestone;  however,  this  was  done  in  some 
cases.  Please  refer  to  examples  Ia  Activities  2B,  4A,  4Bf  4C, 

8A,  7A,  8A,  9A,  lOA,  lOB  and  lOD,  which  vare  completed,  llA,  13B 
and  13C,  which  were  completed,  15A,  17A,  16A,  I8B,  19A,  22A,  24A, 
and  36a. 

b.  We  consider  that  Indicating  actions  as  "complete", 
"underway",  or  "on-going"  to  he  responsive  ,  especially  when  read 
in  conjunction  with  the  description  of  the  actions  to  be  taken  by 
the  offices  assigned  the  implementing  re&ponslbillty.  Again 
please  note  that  paragraph  7a  Indicates  that  siany  activities  had 
calendar  dates  assigned*  We  also  consider  that  the  term  "on¬ 
going"  assigned  to  a  completion  date  indicates  a  long  term 
comsltnent  which  Is  open  ended, 

c.  We  appreciate  your  renarke  in  paragraph  2  on  page 
12  regarding  the  AFHC  points  of  contact  being  knowledgeeble  about 
the  AFMC  Plan  and  each  objective. 

8.  FINDING  "A"  CONCLUSION  ON  PAGES  12  AND  13  OF  THE  REPORT* 
MANAGEMENT  COMMENTS: 

a.  We  concur  with  your  conclusion  on  page  12  that  the 
"OOD  Action  Plan  is  an  Important  planning  document",  that  guality 
assurance  organisations  must  keep  management  focused  on  improving 
quality,  and  that  without  action  plans  and  a  comnitment  to  long- 
range  Improvement,  and  "active  involvement  of  personnel  from 
headquarters  to  field  organisations"  is  essential  for  improved 
quality. 
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EmalRejwrt 

Reference 


Revised 


b.  object  to  the  possible  mlelnterpcetAt ion  of  the 
paragraph  hacauac  it  implies  that  the  seevices  and  DLA  are  not 
interaatad  in  lapcovXng  quality  and  that  they  are  jeopardising 
$5S  billion  in  Cutura  aparaa  procur amenta*  We  recommend  that  the 
laat  aentanca  ba  raeordad  as  followa i 

* Action  plana  must  include  a  commitment  to 
improving  quality  and  these  actions  must  bs  supported  by  the 
commanders  of  all  organizations  concerned”* 

COMMENTS  ON  FINDING  "A”  RECOMMENDATIONS* 

RECOMMENDATIONS  FOR  CORRECTIVE  ACTION  PERTAINING  TO  PZNOING 
•A*  ON  PAGE  13* 

"He  recommend  that  tha  Assistant  Sacrataries  of  the  Army  and 
Navy  (Research#  Development#  and  Acquisition}  #  tha  Assistant  / 
Secretary  of  the  Air  Force  (Acquisition)#  and  the  Director# 
Defense  Dog is tics  Agency s  • 

9*  RECOMMENDATION  1*  ^Establish  policlea  to  reissue 
updated  plans  Cor  implementing  the  DOD  Action  Plan  for 
Continuously  Improving  tha  Quality  of  Spare  and  Repair  Parts 
every  2  years  beginning  in  FV  1994  to  track  the  quality 
improvement  accompli shments ” • 

MANAGEMENT  COMMENTS: 

W«  concur  with  the  intent j  however#  we  believe 
that  it  would  be  batter  to  update  the  plan  on  an  as  required 
basis#  rather  than  on  a  fixed  schedule* 

a«  Under  our  concept#  an  objective  or  an 
activity  would  be  changed  as  required.  For  example,  if  a  change 
was  required  in  12  months,  ve  would  make  the  change  and  not  wait 
for  another  12  months  to  pass  before  talcing  action*  This  will 
assist  in  making  the  plan  a  "living  document*. 

b»  We  plan  to  revise  the  plan;  however,  what 
is  included  in  the  plan  will  depend  upon  the  guidance  that  is 
received  from  OSD  when  it  revises  the  Materiel  Management 
Regulation  (DOD  4140. I^R).  This  was  discussed  in  our  comments 
regarding  Internal  Management  Controls. 

10.  RECOKMEBIDATroN  2.  "Betablish  accountebility  for 
achieving  implementing  action  plan  objectives  and  for  Improving 
the  quality  of  spare  end  repair  parte  byi* 
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R£COHM£tlDAXIOU  2m,  'Updating  implmmantmtion  mction 
plans  to  include  detallsd  In-proaaas  and  plannmd  inltiativsm  foe 
the  OOD  Action  Plan  objectives-* 

RECOMhENDATlOU  2b-  "Updating  implSBientation  action 
plans  to  contain  paeforaance  aeasutes  to  measure  the 
eCfeotlveness  of  each  initiative  in  acconpiishing  dod  Action  Plan 
objectives- * 

recommendation  2c.  "Updating  Implementation  action 
plans  to  include  definite,  realistic  and  obtainable  milestones 
for  completion  of  Initiatives  in  the  action  plans-" 

RECOMMENDATION  2d.  "Assigning  organisational 
responsibility  for  management  oversight  for  implementing  action 
plan  objectives  and  foe  obtaining  feedback  on  the  adequacy  of  the 
initiatives  supporting  the  objectives*" 

management  comments 3 

We  concur  vith  recoamendations  2a  through  2d; 
however-  the  wording  will  depend  upon  oso  guidance  to  be 
published  in  the  revised  DOD  Materiel  Management  Regulation  (DOD 
4140-1-H).  The  contents  ate  currently  being  discussed  by  you  and 
U6D- 


C0HMENT5  ON  PINDINQ  *B"  RZCOMHENDATZONS - 

II-  RECOMMENDATIONS  FOR  CORRECTIVE  ACTION  BASED  ON  YINDING 
*B"  AND  THE  FIVE  RECOMMENDATIONS  ON  PAGES  27,  28,  and  29- 

RECOHMBNDATXQN  B-1-  "We  recommend  that  the  Under  Secretary 
of  Defense  for  Acquisitions 

"a.  Select  a  standard  OOD  vendor  rating  system  for  use 

in  DOD. 


"b.  Establish  regulations  for  implementing  United 
states  Code,  title  10,  section  2383,  to  require  that  contractors 
supplying  critical  aircraft  and  ship  parts  mset  appropriate 
qualification  and  contractual  quality  requirements." 

MANAGEMENT  COMMENTS:  None  -  this  is  an  action  for  USD- 

RECOMMENDATION  B«*2.  "We  recommend  that  the  Assietant 
Secretaries  of  the  Army  and  Navy  (Research,  Development,  and 
Acquisition) «  and  the  Assistant  Secretary  of  the  Air  Force 
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(Acquisition) «  and  tho  Directocr  ]Uiglstic«  Agancyr  update 

the  if  Iftplenteitlng  action  plana  to  show  the  our  cent  or  planned 
actions  to< 

Ji£CCKN£NDATIOK  B-2a.  "Maintain  technical  data  pacKages  and 
nake  thea  availabls,  adequate*  and  accurate  as  an  initiative  tor 
objective  2#  ensure  technical  data  are  available#  adequate#  and 
adequate  toe  use  in  acquiring  quality  spare  parts*” 

KAKAGEKENT  C0HH£^^^S3 

Concur*  Exist  lag  policy  on  the  accujRulation  and 
nalntenance  of  technical  data  packages  and  having  tbem  available 
for  use  in  procuring  quality  pacta  is  in  Air  Force  Materiel 
Command  (AFMC)  Regulation  57-7.  This  regulation  is  being 
revised*  Zt  will  clarify  individual  functional  responsibilities 
in  the  maintenaace  of  technical  information.  «; 

BECOHMENDATZOM  B-2b.  "Comply  with  the  requirementfl  of  the 
Office  of  Procurement  Policy  Letter  No.  91<-3f Reporting 
Nonconforming  Products#  to  participate  in  the  Government-Industry 
Data  Exchange  Program  as  an  initiative  for  objective  23#  Improve 
the  customer  complaint  system.” 

MANAGEMENT  COMMENTS: 

Concur*  The  Air  Force  has  been  participating  in 
the  program  for  30  years*  The  Joint  Logistics  commanders  are  the 
primary  sponsors#  contributing  $3*354  million  of  GXDEP's  4.25 
million  dollar  fX  94  budget*  AFMC  subordinate  units  are  veil 
attuned  to  the  program.  The  program *s  documented  cost  avoidance 
has  increased  from  $540#000  in  1954  to  $61#200#000  in  FT  92. 

The  Air  Force  portion  in  1992  the  cost  avoidance  vas  $15*7 
million* 

RECOMMENDATION  B-2c*  "Support  the  development#  planned 
deploymentr  and  implementation  of  the  DOD-wide  Deficiency 
Reporting  System  as  an  initiative  for  objective  23,  improve  the 
customer  complaint  system.” 

HANAGEHEHT  COMMENTS: 

Concur*  The  Air  Force  Is  supporting  the  Joint 
Logistics  Syateme  Center  (JLSCj  effort  to  implement  a  DOD 
standard  Deficiency  Reporting  System  (DRS) •  It  is  scheduled  for 
Air  Force-wide  implementation  in  July  1994* 
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SECO^WENOATIUN  B-2d .  '*R«duce  th«  number  of  forma  to  report 
nonoonforwancesi  and  standardise  the  forms  and  the  use  of  the 
forms  as  initiatives  for  objective  23,  improve  the  customer 
complaint  system." 

MANAGEMENT  COMMENTS: 

Concur.  The  initial  implementation  of  DRS  will 
use  existing  forms  and  data  elements.  The  objective  of  the  joint 
eery  Ices  is  to  reduce  both  the  number  of  forms  and  the  data 
required  for  subaission- 

RECOMMENDATIOK  S“2e.  "Provide  the  training  needed  to  verify 
that  the  Product  Quality  Deficiency  Reports  program  Is  used 
effectively  as  an  initiative  for  objective  23,  rmprove  the 
customer  complaint  system. * 

MANAGEMENT  COMMENTS: 

Concur.  The  Air  Force  is  considering  on  line  and 
interactive  training  by  the  use  of  computer  programs,  probably 
“floppy  discs,  which  will  “troop  lead*  the  user  through  the 
actions  of  filling  out  the  forms.  This  should  make  the  training 
readily  available  and  easy  to  use.  It  is  planned  to  have  this 
available  in  June  1994. 

RECOMMSNDATlON  3.  "We  recommend  that  the  Assistant 
Secretaries  of  the  Army,  Navy  (Research,  Development,  and 
Acquisition) • ,  the  Assistant  Secretary  of  the  Air  Force 
(Acquisition),  and  the  Director,  Defense  Logistics  Agency,  revise 
their  implementing  plans  tos" 

RSCOHMENDATION  3a.  “Support  an  effort  to  Identify  and 
designate  one  system  as  the  standard  dOD  vendor  rating  system  as 
part  of  an  additional  objective  to  the  pre-contract  phase." 

management  COMMENTS: 

Concur  with  the  intent;  however,  a  single  vendor 
rating  system  (VRS)  may  not  be  viable,  cost  effective,  or  improve 
the  quality  of  space  pacts.  The  value  added  of  a  DOD-wide  system 
is  highly  questionable  because  there  is  little  conmonality  across 
the  secvloes  and  DLA  in  the  products  that  are  bought  and  there 
generally  is  sufficient  information  in  the  service  and  DLA  unique 
systems  to  rate  contractors.  Another  question  is  the  cost  of 
developing  a  DOD  system.  This  recommendation  also  was  addressed 
to  DSD  In  re  commend  at  Ion  la.  Any  action  on  this  should  be 
evaluated  by  a  joint  service,  DLA,  aSD  committee. 
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Page  27 


KGCOHMENDATIOH  3b.  "iMscKibe  tbtt  actions  taken  to  comply 
with  United  States  Code,  title  10,  section  2383,  •Pcocurement  of 
Critical  Aircraft  and  Ship  Parta*,  an  initiative  for  objective 
7#  enauto  that  all  auppllaca  of  space  and  repair  parts  nest  the 
quality  and  technical  requirements «” 

MAMAGEKENT  COHHEKTS: 

Tha  Air  Porcs  in  essence  eomplies  with  Section 
2383  every  time  a  contract  is  written  bscauia  contracts  include 
clauses  regarding  all  aspects  of  the  pcocurtment.  Indications 
ara  that  2383  will  be  repealed  aa  was  recommended  by  the  “Section 
800  Panel*' •  Specifics  regarding  repeal  are  contained  in  Section 
2401  of  the  Senate  Bill  S-1587,  Federal  Stceamllng  Act  of  1993- 
Detailed  justification  is  outlined  on  page  2-107,  paragraph 
2.5.2#  10  use  2383#  of  Chapter  2#  Contract  Administration 
■Streamling  Defease  Acquisition  Laws’'  -  DOD  Jieport  of  the 
Acquisition  Iaw  Advisory  Panel  to  the  United  States  Congress# 
January  1993- 

HKCOHMENDATIOK  3c;  ’’Support  development  of  contractual 
policy  proposals  to  obtain  reimbursement  or  replacement  for 
products  accepted  by  the  Government,  but  later  found  to  contain 
patent  defects#  as  an  initiative  for  Objective  8#  reject  or 
requite  corrections  of  nonconforming  supplies*- 

HANACEMENT  COMMENTS i 

Concur  with  the  Intent.  The  audit  comments  on 

fage  22#  paragraph  2#  described  the  problem  that  is  encountered 
n  trying  to  recoup  damages  for  nonconforming  products  that  were 
delivered  against  old  contracts*  often  the  firms  no  longer  exist 
or  they  refuse  to  discuss  old  contracts  when  the  Covariunent  has 
already  accepted  the  items  and  has  paid  the  contractor- 

a-  our  connents  under  Objective  8  of  our 
plan  cites  the  actions  which  we  can  take  against  aoncon forming 
contractors: 

(1).  To  the  extent  foaslbie#  pursue  firms  to 
correct  product  def Iclencies- 

(2).  Obtain  recoupment  after  acceptance- 

(3).  Use  Product  Deficiency  Quality  Reports 
(PDQRs)  as  a  basis  to  pursua  firms  that  we  believe  are  liable. 

(4).  Place  warranties  in  contracts  to  the 

extent  feasible. 
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b*  We  know  that  we  have  difficulties  in 
obtaining  cecoupment  against  old  contracts.  The  question  la  bow 
to  deal  with  new  procurenents.  We  cannot  "write"  our  way  out  of 
the  quality  problem,  we  must  expect  additional  coats  i£  we 
include  warranty  clauses.  We  need  to  improve  the  acceptance 
process  to  preclude  poor  quality  products  passing  from  the 
supplier r  through  the  DIA  receiving  prooess  at  the  depots r  and  on 
to  the  custoeer.  To  help  improve  this  process,  we  suggest 
expanding  your  Recommendation  3C  by  adding  the  following  at  the 
end  t 

"The  services  and  DLA  should  jointly  examine  the 
product  acceptance  process  to  enhance  the  capability  o£  the 
Qovernnent  to  Identify  and  reject  nonconforming  supplies  and 
require  correction  prior  to  acceptance  by  the  Covornment, 

Snphasis  should  be  placed  on  monitoring  and  control  oC  the 
suppliers'  manufacturing  processes  prior  to  items  being  shipped/ 
to  the  depot. 

RSC0KK£W0ATX0N  3ds  "Remove  nonconforming  products 
Identified  on  Product  Quality  Deficiency  Reports  from  the  Defense 
Supply  System  inventociest  notify  contractors  when  their 
nonconforming  products  are  discovered  and  provide  copies  of 
quality  deficiency  Information  to  ooatractors  so  the  contractors 
can  correct  the  cause  of  the  quality  failure/  inform  contracting 
officers  so  they  can  attempt  to  recoup  the  value  of  nonconforming 
products;  and  document  the  quality  assurance  decisions  to  request 
or  not  request  laboratory  testing  need  to  support  Product  Quality 
Deficiency  Report  Initiatives  for  Objsctive  23#  improve  the 
customer  complaint  system". 

KARACXMSWt  COMMENTS i 

Concur  with  the  latent;  however,  we  believe  that 
the  proposed  actions  are  too  specific  to  bo  implomcnted  as 
written.  Some  are  already  in  procedures.  Further,  offices 
responsible  for  the  processes  nsed  latitude  to  Implement  their 
initiatives.  Based  on  this#  we  recommend  that  the  following  be 
inserted  at  the  beginning  of  your  Recommendation  3dt 

"Materiel  commands  and  DCA#  to  the  extent  feasible, 
will  consider  the  following  aotlons,  either  individually  or 
together#  in  order  to  improve  product  quality." 
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recommendation  *D6v«lop  strategi*!  for  cost  offectlvsly 

targeting  quality  assurance  laboratory  tasting  to  identify 
susceptible  product  lines  and  problem  contractors#  and  to 
randomly  test  the  products  supplied  by  problem  suppliers  at  every 
national  inventory  control  point  as  an  added  objective  (or  the 
feedback  Intelligence  phase”* 

MANAGEMENT  COMMENTS; 

Concur  with  the  intent*  W«  believe  that  the  best 
expenditure  of  funds  would  be  to  enhance  the  inspections  of  the 
processes  at  the  suppliers*  plants.  By  doing  thiar  we  would  sore 
readily  preclude  bad  parts  being  shipped  to  i>00  depots.  While  we 
interpose  no  objection  to  placing  this  in  the  ”Feedback 
Intelligence  phase”  of  the  DOD  Plan,  we  believe  that  It  should  be 
a  part  of  Objective  22  (Enhance  the  use  of  DOD  and  independent 
laboratory  testing  resources) .  We  cecouend  that:  ; 

a.  The  words  ”Subject  to  the  availability  of 
resources”  be  inserted  at  the  beginning  of  RecoRsendation  3e« 

b.  our  added  words  and  Recommendation  3a 
become  Activity  22b.  Currently  there  is  only  Activity  22a. 

RECOMMENDATION  3f.  "Evaluate  the  adequacy  of  quality 
assurance  laboratory  test  plans  as  an  initiative  for  objective 
22,  enhance  the  use  of  QOO  and  independent  laboratory  test 
capabilities” • 

MAHACEMENT  COMMENTS; 

Concur  with  the  intent*  See  our  coiunents  under 
Recommendation  3e  that  the  best  way  to  eliminate  bad  parts  is  to 
work  on  the  contractors*  in  plant  processes;  however,  assuming 
that  the  Defense  Contract  Management  Command  (DCHC)  cannot 
achieve  this  in  all  cases,  we  concur  that  laboratory  testing  is 
essential  even  though  it  is  expensive  and  generally  must  be  used 
selectively*  Because  of  testing  costs  and  decreasing  budgets,  we 
recommend  that  the  following  change  be  made  in  Recommendation  3fi 

Insert  the  words  "Subject  to  the  availability 
of  resources”  at  the  beginning  of  the  recommendation. 

RECOMMENDATION  4i  ”We  rsconunend  that  the  Assistant 
Secretaries  of  the  Army  and  Navy  (Research,  Development,  and 
Acquisition)  and  the  Assistant  Secretary  of  the  Air  Force 
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(Acquisition)  covise  fcb«  Mllifcsry  DopartMent  lttpie»eDting  action 
plans  by  adding  an  initiative  to  test  ptoduct  lines  stored  in 
depot  Inventories  suspected  ot  containing  nonconforning  products 
as  part  of  abjective  18 r  identify  and  purge  nonconforming 
material  from  wholesale  inventory,* 

MANAGEMENT  COMMENTS: 

1,  Concur  with  the  intent:  however#  we  recommend 
that  Jle commendation  A  ba  deleted  based  on  the  following  comments t 

2,  Recommendation  4  duplicates  Objective  18 
(Identify  and  purge  nonconforning  material  fron  wholesale  level 
inventory)  and  Its  two  activities  -  18 A  and  18B. 

a.  Activity  18A  says  to  •Laboratory  test  new 
receipts  of  safety  and  weapon  system  critical  Items  for 
nonconformance.  Vlthln  resources#  apply  sample  testing  to 
noncritical  itema^. 

b.  Activity  188  says  •Review  existing 
Pcoauct  Quality  DeCiclenoy  Report,  (PDQRs)  for  idantlfication  o£ 
validated  major  nonconformances.  Also  consider  Government 
Industry  Data  Exchange  Program  (GlDfiP)  Safety  Alerts p  and  other 
feedback  naans#  to  identify  suspaot  parts.  Suspend  issue  of  such 
stock  pending  Inspection  and  laboratory  tast.* 

3,  Please  note  that: 

a.  Activity  18A  addresses  •critical*  items. 

b.  Activity  18B  addrasses  using  available 
information  to  identify  parts  having  *iiiAjor*  nonconformances , 

4,  If  we  add  an  initiative  (Activity)  IBC  as 
suggestad  by  Hecoamendation  4#  it  would  be  an  Activity  that  could 
not#  within  itaelf#  be  complied  with  because i 

a.  We  would  have  no  basis  for  determining  if 
a  part  was  •suspect"  unless  we  received  data  such  as  a  PQDR  or  a 
safety  alert  which  is  already  covered  In  Activity  188. 

b.  Further#  the  proposed  Activity  18C  would 
require  testing  of  all  suspect  items#  assuming  that  we  could 
identify  them-  Purging  all  nonconforming  Items  Is  not  desirable 
or  cost  effective  because  there  ore  many  items,  which  while  they 
may  be  nonconforming#  but  do  not  warrant  purging  because  the 
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daf.ct  i«  not  on  a  -qiitlcal*  itenipc  ia  not  a  "“ioiE'  „ 
noncontotnanea.  In  adaitlon,  contractin9.ofCic*t»  of tan 
authoriza  waivacs  ot  daviations  from  apeoificattona  or  contract 
provisions • 

RECOWMENDATION  5  a  have  not  reapondod  to  Recoawondatlon  5 

bocauso  it  la  addreaaad  to  OLA  and  calatea  to  Improving  tba  dla 
plana 
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MEMOIIANDUM  FOR  ASSISTANT  INSPECTOR  GENERAL  FOR  AODtTIMO, 

dspartment  of  defense 

SUBJECT  I  Report  on  DoD  Component  luqplementing  Action  Plans  for 
Improving  the  Quality  of  Spare  Parts  (Project  No. 
aCF-OOSB) 

This  is  In  response  to  your  17  November  1993  request. 


35  find 


//JACQ^INE  G.  BRYANT 
^  Chief,  Internal  Review  Office 
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PURPOSE  OP  INPUT!  INITIAL  POSITION 

AUDiT  TITLE  AND  NO:  Draft  Report  on  DoD  Component  Implementing  Action 
Plans  for  Improving  the  Quality  of  Spare  Parts 
(Project  No.  2CF-0053) 

FINDING  A:  Accountability  in  Implementing  Action  Plans.  DoD  Component 
implementing  action  plans  did  not  include  the  bases  for  holding 
management  officials  accountable  for  achieving  quality  assurance  program 
results  and  for  continuously  improving  the  quality  of  spare  and  repair 
parts.  Implementing  action  plana  lacked  accountability  because  the  DoD 
Components  did  not  establish  definite  performance  measures  to  assess 
program  results  and  did  not  set  realistic,  time-phased,  long-range 
milestones.  In  addition  the  DoD  Components  did  not  develop  procedures 
for  obtaining  feedback  from  the  users  of  spare  and  repair  parts  regarding 
the  adequacy  of  the  action  plans,  and  the  Army,  Navy,  and  DLA  did  not 
assign  or  reassign  responsibilities  for  implementing  the  action  plans. 

As  a  result,  the  DoD  Components  could  not  use  the  implementing  action 
plans  as  a  management  tool  for  measuring  the  effectiveness  of  quality 
program  results. 

DLA  COMMENTS:  Nonconcur.  The  DLA  Action  Plan  assigned  Offices  of 
Primary  Interest  (OPIs)  for  each  objective  and  activity.  The  heads  of 
t:hese  activities  were  held  accountable  for  (1)  the  initiatives  that  were 
developed,  (2)  the  milestones  to  be  met,  (3)  the  monitoring  of  the  per¬ 
formance  measures,  and  (4)  the  status  updates  made  in  the  DLA  on-line 
computer  system  and  periodic  briefings  to  the  DLA  Director  and/or  Deputy 
Director.  DLA  definitely  used  the  Action  Plan  as  an  Agency-wide  manage¬ 
ment  tool  to  improve  product  quality.  Many  of  the  DLA  May  1990  Action 
Plan  initiatives  are  complete  and  with  very  positive  results  in  improving 
the  overall  quality  of  spare  and  repair  parts,  as  confirmed/measured 
through  the  DLA  hardware  Inventory  Control  Points  (ICPs)  random 
laboratory  testing  results. 

Accountability.  The  May  90  DLA  Action  Plan  identified  OPIs  for  each 
objective/activity.  The  OPI  was  at  the  Primary  Staff  Element  (PSE) 
level  under  the  old  DLA  organization  and  reported  directly  to  the  Agency 
Director.  PSE  Heads,  normally  at  SES/Flag  Officer  level,  were  held 
accountable  for  achieving  the  May  1990  DLA  Action  Plan  objectives  and 
activities  and  meeting  their  associated  milestones.  Action  Plan  manage¬ 
ment  oversight  was  present  through  OPI /senior  corporate  leadership  mon¬ 
itoring  of  Action  Plan  initiatives/status,  updates  into  the  DLA  on-line 
computer  system,  milestone  accomplishments,  overall  Action  Plan  perfor¬ 
mance  measures,  and  briefings  to  senior  Agency  leadership.  In  addition, 
the  DLA  Deputy  Director,  personally  monitored  the  Action  Plan  -- 
initiatives,  milestones,  performance  measures,  and  computerized  status 
updates  --  on  a  quarterly  basis.  This  is  evident  through  the  many  pieces 
of  correspondence  that  the  Deputy  Director  sent  to  OPIs  for 
clarification/  explanation.  Periodic  Action  Plan  status  update  briefings 
were  chaired  by  the  Deputy  Director  and  included  the  PSEs  and  other 
senior  officials  such  as  the  DLA  Director  and  DoD  IG  personnel  (including 
Mr.  Vender  Schaaf ) . 

Feedback  From  Users.  There  was  no  requirement  for  DLA  to  obtain  feedback 
from  the  "users"  of  spare  and  repair  parts  regarding  the  adequacy  of  the 
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DLA  Action  Plan.  Certainly  "users"  or  customer  needs  and  expectations 
were  key  to  developing  many  of  the  DLA  Action  Plan  initiatives.  However, 
feedback  on  the  DLA  Action  Plan  itself  would  not  be  meaningful  as  our 
customers  are  typically  concerned  about  the  increase  in  the  level  of 
quality  materiel  and  service  rather  than  how  that  increase  is/was 
accomplished.  The  DLA  Action  Plans  were  provided  to  Military  Service 
activities  that  perform  procurement  and  logistics  functions,  i.e..  Army 
Materiel  Command,  Office  of  the  Secretary  of  Navy/NAVSUP/NAVSEA/NAVAIR, 
Air  Force  [then]  Systems  Command  and  Logistics  Command.  In  turn,  DLA 
obtained  copies  of  the  Military  Services  Action  Plans. 

Milestones .  DIjA*s  Action  Plan  contained  definite,  realistic,  and 
obtainable  milestones  for  identified  activities  and  tasks.  For  our 
initial  initiatives/tasks  or  for  new  tasks  that  were  added,  these 
milestones  were  updated  in  DLA's  on-line  computer  system  when  required  , 

DLA  disagrees  with  the  DoD  IG's  associated  finding  under  "BXiA  Milestones" 
on  page  11  that:  ".*•  DLA  provided  near-term  (1989  and  1990)  milestones 
for  14  of  the  26  objectives  in  the  DLA  Action  Plan*  However#  DLA's  use 
of  near-term  milestonea  understated  the  long-range  problems  associated 
most  of  the  DoD  Action  Plan  objectives** 

All  objectives  in  the  DLA  Action  Plan  had  milestones.  In  the 
automated  version  of  the  DLA  Action  Plan,  each  new  initiative  had 
milestones  assigned.  DLA  Action  Plan  initiatives  were  not  all 
short-term,  one-time  responses.  Many  initiatives  were  quite  extensive. 
Some  Action  Plan  initiatives  are  still  continuing  and  will  have  a  lasting 
effect  upon  quality;  e.g.,  In-Plant  Quality  Evaluation,  Best  Value 
Contracting,  GIDEP  usage,  Contractor  Profile  System,  MEDALS,  logistic 
reassignment ,  materiel  receipt  inspection,  and  the  laboratory  testing 
program .  . 

DLA  disagrees  that  the  use  of  near-term  initiatives  by  DLA  xmderstates 
the  long-range  problem. 

While  in  some  cases,  our  initiative  milestones  recjuired  revision, 
the  very  essence  of  an  Action  Plan  is  to  create  action  --to  change  a 
given  situation;  i.e.,  improve  product  quality.  Setting  and 
accomplishing  near-term  milestones  focused  action  on  incremental 
improvements  that  did/will  eventually  resolve  long-range  problems.  DLA 
has  been  successful  in  this  effort  as  confirmed  by  an  overall  quality 
improvement.  The  results  of  random  laboratory  testing  conducted  by  the 
DLA  hardware  Inventory  Control  Points  (ICPs) ,  our  primary  quality 
improvement  metric,  show  that  the  percentage  of  lots  (national  stock 
numbers)  rejected  has  declined  significantly  since  Fiscal  Year  1990  when 
we  began  implementing  the  May  1990  DLA  Action  Plan. 

Perf9tnian.c.g_Meagyxgg  and..g9.g.^ag....a  Definite  and 

realistic  performance  measures  were  established  for  each  Activity  and 
Task  in  the  DLA  Action  Plan  to  track  action  completions  and  assess 
quality  program  results.  Qualitative  (accomplishment -oriented)  measures 
were  identified  for  each  milestone  to  track  accomplishment  (completion) 
of  specific  actions  linked  to  a  specific  Activity  or  Task.  Quantitative 
measures  were  identified  for  specific  activities  whenever  results  could 
be  directly  attributable  to  a  specific  activity;  e.g.,  number  of  waivers 
approved  to  number  of  technical  data  packages  changed,  inspection  and 
audit  results,  and  trend  data  for  delinquencies  and  nonconformances.  In 
addition,  there  were  overall  measures  of  quality  and  Action  Plan 
successes;  e.g.,  random  laboratory  testing  results.  Unquestionably,  the 
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DLA  Action  Plan  was  used  as  an  effective  management  tool  with  appropriate 
performance  measures  to  improve  product  quality.  The  dramatic  increase 
in  DLA's  quality  level,  after  implementing  the  May  1990  Action  Plan, 
indicates  both  (1)  meaningful  initiatives  were  included  in  the  DIA  Action 
Plan  and  (2)  the  Action  Plan  was  effectively  used  as  a  management  tool. 

DLA  disagrees  with  the  DoD  IG's  statements  under  ■Performance  Measures  in 
DoD  Component  Inplementlng  Action  Plans*  on  page  10  that;  ■...  DLA 
performance  measures  were  not  always  meaningful  and  did  not  provide  for 
quantifiable  measure  of  progress  from  established  baselines*  For 
example,  DLA  described  two  performance  measures  for  objective  18, 

Identify  and  purge  nonconforming  materiel  from  tdiolesale  level  inventory. 
The  two  performance  measures  are  quality  control  product  quality 
audit  results  and  technical  assistance  and  operational  review  and 
quality  assurance  management  review  visits.  The  objective  18  performance 
measures  do  not  provids  for  anything  other  than  ongoing  management 
programs  and  do  not  describe  quantifiable  meas\ures  of  progress  such  as 
reduced  nonconformances  from  sn  established  baseline.” 

In  fact,  DLA's  performance  measures  for  objective  18  are  not  just 
ongoing  programs.  Quality  control  and  product  quality  audit  results  are 
numerical  measures  of  a  number  of  inspections  versus  a  number  of 
nonconformances  which  results  in  a  percent -defect  rate.  These  rates  are 
compared  against  a  baseline  of  previous  nonconformances  and  provides  a 
basis  for  further  analysis  as  necessary.  The  number  of  findings /problems 
identified  with  the  purge  program  during  reviews /visits  can  also  be 
quantified  and  used  to  directly  measure  progress  in  this  specific  area. 

Moyg  PLA  Rat ional^For  Action  Plan  Measures.  The  DLA  Action  Plan  had  a 
number  of  activities,  initiatives,  and  tasks  requiring  measures  to  track 
progress  and  assess  success.  Our  approach  to  measurement  was  to  have 
measures  to  both  assess  overall  Action  Plan  effectiveness  and 
track/assess  individual  actions/activities  with  appropriate  measures  -- 
<^alitatiye,  quantitative  or  both.  For  some  initiatives  (e.g.,  an 
initiative  to  develop,  issue,  and  implement  a  new/iB5>roved  policy), 
qualitative  performance  measures  (accomplishment -oriented)  are  meaningful 
performance  measures  Of  progress.  These  include  measures  such  as 
"...timely  completion  of  associated  tasks  and  milestones...”  and 
"  .  .  .on-site  HQ  DLA  Quality  Management  Reviews  at  ICPs  to  assess 

new/ improved  policy  effectiveness/  implementation _ ■  Quantitative 

measures  are  used  whenever  and  wherever  meaningful.  However,  when  you 
implement  a  plan  with  widely  diverse  initiatives  that  complement  and 
reinforce  each  other  as  the  DLA  Action  Plan,  it  is  not  possible  to 
determine  precisely  which  individual  initiatives  caused  or  cause  overall 
measures  of  product  quality  (e.g.,  random  laboratory  testing  results)  to 
improve  nor  how  much  each  individual  initiative  contributed/contributes 
to  overall  improvement.  Therefore,  individual  initiatives  will  need  to 
use  qualitative  performance  measures  of  sufficiency,  as  well  as 
quantitative  performance  measures  where  feasible/appropriate. 

The  overall  measures  of  product  quality,  such  as  random  laboratory 
testing  results,  are  the  important  Action  Plan  performance  measures. 

They  measure  the  bottom-line;  i.e.,  whether  or  not  the  initiatives  in 
the  Action  Plan  have  collectively  improved  the  quality  of  spare  and 
repair  parte. 

OTHER  FINDING  SUPPORT  COMMENTARY  WHERE  DLA  DISAGREES 

DLA  disagrees  with  the  DoD  IG's  statement  that  "DLA  did  not  reissue  an 
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up<Ut#d  Version  of  thm  DLX  Action  Plan  aftar  May  1990.* 

An  automated  version  of  the  DLA  Action  Plan  was  used  in  lieu  of 
publishing  an  updated  glossy  version.  Periodic  updates  insured  a 
continually  current  DLA  Action  Plan  instead  of  a  static  hard-copy  plan. 
Future  Action  Plans,  when  they  become  necessary,  should  continue  to  use 
modem  automation  technology  to  remain  current  and  provide  widespread 
access.  Hard-copy  Action  Plana  can  be  obtained  directly  from  the 
automated  version  whenever  necessary. 

DLA  disagrees  with  the  implication  inherent  in  the  statement:  "The  DLA 

Action  Plan  cited  the  offices  of  priaary  responaibility  for  all  26 
objectives,  but  the  points  of  contact  for  six  objectives  could  not  answer 
basic  questions  and  did  not  )mow  who  to  contact  to  obtain  answers 
regarding  the  Initiatives  under  the  objective.* 

Although  the  timing  of  the  DoD  IG  Audit  was  concurrent  with  the 
largest  HQ  DLA  reorganization  in  the  Agency's  history,  the  DoD  IG 
Auditors  were  ashed  to  inform  DIA  (during  the  initial  in-brief  and  by  the 
DLA  Action  Plan  audit  Point  of  Contact  (POC) )  if  additional  assistance 
was  required  to  identify  objective/initiative  OPIs/POCs  (past  and 
present)  during  their  audit.  Admittedly,  during  the  reorganization,  many 
functions  were  transferred  and  the  new  action  officers  may  not  have  had 
full  )cnowledge  of  previous  actions  for  their  initiatives.  This  was  a 
temporary  situation  and  responsibilities  were  quickly  clarified.  DOD  IG 
should  have  provided  DLA  the  opportunity  to  find  the  appropriate  action 
officers. 


DISPOSITION; 

(  )  Action  is  ongoing.  Estimated  Completion  Date: 

(X)  Action  is  considered  complete. 

INTERNAL  MANAGEMENT  CONTROL  WEAKNESSES: 

(X)  Nonconcur.  (Rationale  must  be  documented  and  maintained  with  your 
copy  of  the  response . ) 

(  )  Concur;  however,  weakness  is  not  considered  material.  (Rationale 
must  be  documented  and  maintained  with  your  copy  of  the  response.) 

(  )  Concur;  weakness  is  material  and  will  be  reported  in  the  DLA 
Annual  Statement  of  Assurance. 

MONETARY  BENEFITS ;  N/A 

DLA  COMMENTS :  N/A 

ESTIMATED  REALIZATION  DATE;  N/A 

AMOUNT  REALIZED:  N/A 

DATE  BENEFITS  REALIZED:  N/A 


ACTION  OFFICER: 
REVIEW/APPROVAL; 

COORDINATION; 


DLA  APPROVAL; 

2  2  FEB  1934 


Duane  Rice,  MMSLP,  617-0506,  17  Dec  93 
James  J.  Grady,  Jr.,  Deputy  Executive  Director,  Supply 
Management,  MMSD,  x7051O,  1/26/94 
AQCO 

Anthony  Broadncoc,  DDAI,  x49607,  2/1/94 
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Ffaud  Report 

BrfiargM . 


Revised 


RECOMMENDATION  A.l;  We  recommend  that  the  Assistant  Secretaries  of  the 
Army  and  Navy  {Research,  Development,  and  Acquisition),  the  Assistant 
Secretary  of  the  Air  Force  (Acquisition),  and  the  Director,  Defense 
Logistics  Agency  establish  policies  to  reissue  updated  plana  for 
implementing  the  DoD  Action  Plan  for  Continuously  Improving  the  Quality 
of  Spare  and  Repair  Parts  every  2  years  beginning  in  FY  1994  to  track 
quality  improvement  accomplishments. 

DLA  COMMENTS;  Nonconcur.  DLA  disagrees  with  establishing  a  policy  to 
reissue  an  u^ated  plan  for  implementing  the  DoD  Action  Plan  for 
Continuously  Improving  the  Quality  of  Spare  and  Repair  Parts  arbitrarily 
every  two  years  to  track  quality  improvement  accomplishments.  The  May 
1990  DLA  Action  Plan,  although  not  updated  in  a  hard-copy  edition,  was  a 
living  document  and,  in  many  ways,  superior  to  an  updated  hard-copy  plan. 
DLA  Offices  of  Primary  Interest  (OPIs)  for  individual 
objectives/activiticB  (initiatives)  used  the  on-line  Distributive 
Miniature  Information  System  (DMINS)  to  periodically  update  their 
activities.  The  automated  aspects  of  DLA’s  Action  Plan  contributed 
significantly  to  improving  the  tracking  of  initiative  status  and 
providing  an  avenue  to  keep  initiative  status  current  and  on  track  for 
successful  initiative  completion.  The  DLA  Action  Plan  has  been  effective 
and  since  its  implementation  in  1990,  the  quality  of  DLA 
product 8 /materiel  has  improved.  This  inprovement  has  been  confirmed/ 
measured  by  the  results  of  random  laboratory  testing  conducted  by  the  DLA 
hardware  Inventory  Control  Points  (ICPs);  i.e.,  Defense  Construction 
Supply  Center  (DCSC) ,  Defense  Electronics  Supply  Center  (DESC) ,  Defense 
General  Supply  Center  (DGSC) ,  and  Defense  Industrial  Supply  Center 
(DISC)  ,  Since  PY  1990,  the  DLA  Action  Plan  has  provided  us  improved 
product  quality  as  measured  by  the  percentage  of  lots  (national  stock 
numbers)  rejected  on  new  procurements. 

DLA  has  decided  to  issue  one  more  new  hard-copy  edition  of  its  Action 
Plan  with  the  goal  of  further  reducing  the  rate  of  nonconforming 
materiel.  As  with  the  May  1990  DLA  Action  Plan,  OPIs  will  periodically 
update  their  initiatives,  as  necessary,  on  an  automated  version  of  this 
Action  Plan  and  not  arbitrarily  at  a  fixed  two-year  fre^ency.  DLA  may 
or  may  not  publish  another  hard-copy  edition  of  its  Action  Plan  in  PY 
1996.  That  decision  will  be  made  at  that  time  based  upon  the  overall 
measures  of  product  quality  that  will  be  tracked;  e.g.,  random  laboratory 
testing  results,  random  distribution  depot  product  quality  audit  results, 
valid  Product  Quality  Deficiency  Reports  (PQDRs)  received  at  the  DLA 
ICPs,  and  valid  PQDRs  received  by  the  Defense  Contract  Management  Command 
(DCMC)  on  source  inspected  materiel  on  DCMC- administered  contracts.  If 
no  further  hard-copy  DIA  Action  Plans  are  published,  cjuality  initiatives 
will  continue  to  be  integrated  into  our  overall  DIA  Strategic  Plans, 
business  plans,  amd  business  processes. 


RECOMMETOATION  A.2.a;  We  recommend  that  the  Assistant  Secretaries  of  the 
Army  and  Navy  (Research,  Development,  and  Acquisition),  the  Assistant- 
Secretary  of  the  Air  Force  (Acquisition),  and  the  D?rUtor? 

Logistics  Agency  establish  accountability  for  achieving  implementing 
actions  plan  objectives  and  for  improving  the  quality  If  spare  and  repair 
parts  by  updating  implementing  action  plans  to  include  detailed  " 
in-process  and  planned  Initiatives  for  DoD  Action  Plan  objectives. 
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DIA  CX)MMENTS;  Nonconcur.  DLA  will  not  be  updating  the  May  90  DLA  Action 
Plan  with  initiatives  that  strictly  follow  the  DoD  Action  Plan 
objectives.  As  discussed  in  Finding  A,  DXA  already  established 
accountability  and  updated  the  May  90  DLA  Action  Plan  appropriately. 

DLA  has  developed  a  new  hard-copy  edition  of  an  Action  Plan  with  the  goal 
of  further  reducing  the  rate  of  nonconforming  materiel.  This  new  edition 
of  the  DLA  Action  Plem  only  contains  in-process  and  planned 
initiatives/actions  for  those  old  DoD  Action  Plan  objectives  still 
requiring  pursuit,  as  well  as  some  completely  new  initiatives  not  related 
to  the  old  DoD  Action  Plan  objectives.  DLA*s  new  edition  of  its  Action 
Plan  does  not  follow  the  outdated  format/objectives  of  the  old  DoD  Action 
Plan.  While  there  will  be  an  initial  hard-copy  edition  and  a  master  copy 
maintained  by  the  Action  Plan  Administrator,  the  primazy  edition  of  the 
DLA  Action  Plan  will  be  a  living  document  --an  automated  document. 
Designated  Points  of  Contact  (POCs)  for  in-process  and  planned 
initiatives  in  this  edition  will  periodically  update  their  initiatives, 
when  warranted.  In  the  future,  initiatives  may  be  added,  deleted,  or 
modified  (as  they  were  for  the  May  90  Action  Plan)  based  upon 
review/analysia  of  the  initiatives’  progress  and  the  overall  measures  of 
product  quality;  e.g.,  random  laboratory  testing  results,  random 
distribution  depot  product  quality  audit  results,  valid  Product  Quality 
Deficiency  Reports  (PQDRs)  received  at  the  DLA  ICPs,  and  valid  PQDRs 
received  by  DCMC  on  source  inspected  materiel  on  DCMC-administered 
contracts.  The  Deputy  Directors  of  Acquisition  and  Material  Management 
will  provide  senior  corporate  leadership  for  the  new  plan  and  will  be 
briefed  on  current  status  as  appropriate. 


RECOMMENDATION  A.2.b:  We  recommend  that  the  Assistant  Secretaries  of  the 
Army  and  Navy  (Research,  Development,  and  Acquisition),  the  Assistant 
Secretary  of  the  Air  Force  (Acquisition) ,  and  the  Director,  Defense 
Logistics  Agency  establish  accountability  for  achieving  implementing 
actions  plan  objectives  and  for  improving  the  quality  of  spare  and  repair 
parts  by  updating  implementing  action  plans  to  contain  performance 
measures  to  measure  the  effectiveness  of  each  initiative  in  accomplishing 
DoD  Action  Plan  objectives, 

DLA  COMMENTS:  Nonconcur.  DLA  will  not  be  updating  the  May  90  DLA  Action 
Plan  with  initiatives  that  strictly  follow  the  DoD  Action  Plan 
objectives.  As  discussed  in  Finding  A,  DLA  already  established 
accountability  and  updated  the  May  90  DLA  Action  Plan  appropriately.  The 
May  90  DLA  Action  Plan  contained  definite  and  realistic  performance 
measures  for  each  activity  and  task  to  track  completion  and  assess 
results. 

DLA  is  in  the  process  of  developing  a  new  Action  Plan  (hard-copy  edition) 
with  the  goal  of  further  reducing  the  rate  of  nonconforming  materiel. 
Hbwever,  this  edition  will  only  contain  in-process  and  planned 
initiatives  for  those  old  DoD  Action  Plan  objectives  still  requiring 
pursuit,  as  well  as  some  completely  new  initiatives  not  related  to  the 
old  DoD  Action  Plan  objectives.  DLA’s  new  Action  Plan  will  not  follow 
the  outdated  format/objectives  of  the  old  DoD  Action  Plan.  The 
initiatives  in  the  new  DLA  Action  Plan  will  contain  performance  measures 
that  may  be  either  qualitative  or  quantitative  or  both.  Every  initiative 
will  not  contain  a  quantitative  performance  measure. 
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Action  Plan  will  also  contain  overall  neasures  of  product 
^*5’'  >^®r*dom  laboratory  testing  results,  random  dlstrihnMnn 
depot  product  quality  audit  results,  valid  Product  Quality  ^ficien^ 
^^rts  (PQDRs)  received  at  the  DIA  ICPs,  valid  TOD^  receiS^S  tS 
Management  Command  (DCMC)  on  source  inspe^ed  StSiel 
^  contracts,  and  valid  customer  compl^nts  a^inst 

lines  shipped.  DIA  firmly  believes  that 
these  overall  product  quality  performance  measures  are  the -na 
measures  of  the  success  of  an  Action  Plan  rather  thLi 
individual  initiatives'  performance  measures.  ^ 


RBCOMMEKDATION  A.2,c:  We  recommend  th^it  the  Assistant  Secretaries  of  the 
Array  and  Navy  (Research,  Development,  and  Acquisition),  the  Assistant 
Secretary  of  the  Air  Force  (Acquisition) ,  and  the  Director,  Defense 
Logistics  Agency  establish  accountability  for  achieving  implementing 
actions  plan  objectives  and  for  improving  the  quality  of  spare  and  repair 
parts  by  updating  implementing  action  plans  to  include  definite, 
realistic  and  obtainable  milestones  for  completion  of  initiatives  in  the 
action  plans. 

DLA  COMMENTS;  Nonconcur,  DLA  will  not  be  updating  the  May  90  DLA  Action 
Plan  with  initiatives  that  strictly  follow  the  old  DoD  Action  Plan 
objectives.  As  discussed  in  Finding  A,  DLA  already  established 
accountability  and  updated  the  May  90  DLA  Action  Plan  appropriately.  The 
May  90  DIA  Action  Plan  contained  definite,  realistic  and  obtainable 
milestones  and  many  of  these  milestones  are  now  completed. 

DIA  has  developed  a  hard-copy  edition  of  a  new  Action  Plan  with  the  goal 
of  further  reducing  the  rate  of  nonconforming  materiel.  This  new  edition 
only  contains  in-process  and  planned  initiatives  for  those  old  DoD 
Action  Plan  objectives  still  requiring  pursuit,  as  well  as  some 
completely  new  initiatives  not  related  to  the  old  DoD  Action  Plan 
objectives.  DIA* a  new  Action  Plan  will  follow  the  most  appropriate 
format  and  not  necessarily  all  the  objectives  nor  format  of  the  old  DoD 
Action  Plan.  The  new  edition  will  include  definite,  realistic,  and 
obtainable  milestones  for  completion  of  its  initiatives.  Nevertheless, 
many  of  the  milestones  will  be,  appropriately,  near-term.  Milestones 
identified  for  individual  tasks  or  actions  supporting  initiatives  in  the 
new  DIA  Action  Plan  represent  our  best  estimates  and  may  change  for  any 
of  a  number  of  reasons.  Therefore,  adding  or  extending  individual 
action/task  milestones  will  not  necessarily  indicate  a  problem.  He  will 
eraphasiie  overall  measures  of  product  quality,  such  as  random  laboratory 
testing  results.  Such  performance  measures  will  indicate  whether  or  not 
the  new  DIA  Action  Plan  is  achieving  continuous  improvement  in  the 
quality  of  spare  and  repair  parts.  Initiatives  and  associated  milestones 
may  be  modified,  added,  or  deleted  based  upon  review/analysis  of  overall 
product  quality  measures  and  the  progress  of  individual  initiatives. 
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RECOMMENDATION  A.2.d:  He  recommend  that  the  Assistant  Secretaries  of  the 
Army  and  Navy  (Research,  Development,  and  Acquisition),  the  Assistant 
Secretary  of  the  Air  Force  (Acquisition),  and  the  Director,  Defense 
Logistics  Agency  establish  accountability  for  achieving  implementing 
actions  plan  objectives  and  for  improving  the  quality  of  spare  and  repair 
parts  by  assigning  organizational  responsibility  for  management  oversight 
for  implementing  action  plan  objectives  and  for  obtaining  feedback  on  the 
adequacy  of  the  initiatives  supporting  the  objectives, 

DliA  COMMENTS:  Nonconcur.  As  discussed  in  Finding  A,  DXA  already 
established  accountability,  assigned  organizational  responsibility  and 
had  appropriate  management  oversight  for  achieving  the  action  plan 
objectives. 

In  the  May  90  DLA  Action  Plan,  Offices  of  Primary  Interest  (OPIs)  were 
identified  for  each  objective  and  activity.  The  heads  of  these  offices 
were  held  accountable  for  achieving  the  May  90  DLA  Action  Plan  objectives 
and  activities.  Management  oversight  was  present  through  status  updates 
in  the  DLA  on-line  computer  system;  monitoring  of  DLA's  Kay  90  Action 
Plan  initiatives,  milestones,  and  performance  measures;  status  updates  on 
a  quarterly  basis  which  were  personally  monitored  by  the  DLA  Deputy 
Director;  and  periodic  briefings  on  the  status  of  DLA's  May  90  Action 
Plan  Initiatives  to  senior  management  officials  including  the  DLA 
Director,  Principle  Staff  Element  heads,  and  DoD  IG  personnel. 

DI^  has  developed  a  new  Action  Plan  with  the  goal  of  further  reducing  the 
rate  of  nonconforming  materiel.  This  new  DLA  Action  Plan  only  contains 
in-process  and  planned  initiatives  for  those  old  DoD  Action  Plan 
objectives  still  requiring  pursuit,  as  well  as  some  completely  new 
initiatives  which  may  not  be  related  to  the  old  DoD  Action  Plan 
objectives.  DLA's  new  Action  Plan  follows  a  format  that  will  give  lis  the 
best  method  for  objective/  initiative  accomplishment  and  not  necessarily 
the  old  format /objectives  of  the  DoD  Action  Plan.  However,  Points  Of 
Contact  (POCs)  will  again  be  assigned  (just  as  they  were  under  the  May  90 
I  DLA  Action  Plan)  for  each  initiative  in  the  new  DLA  Action  Plan.  These 
POCs  will  be  assigned  organizational  responsibility  for  management 
oversight  of  their  respective  initiatives  and  for  updating/m^ifying 
their  initial: ives  based  upon  the  review/analysis  of  overall  product 
quality  measures  and  the  progress  of  individual  initiatives. 

DIA  takes  exception  to  the  DoD  IG  including  in  its  finding  under  ■DLA*  on 
page  12  for  ■Rasponslbilitlss  and  Feedback*  that:  ■DLA  did  not 
distribute  the  DLA  Action  Plan  to  the  users  of  spare  and  repair  parts  for 
feedback," 

There  was  no  requirement  for  DLA  to  distribute  the  DLA,  Action  Plan 
to  the  users  of  spare  and  repair  parts  for  feedback.  The  users  of 
DLA- supplied  spare  and  repair  parts  expect  to  receive  conforming/usable 
parts,  at  a  reasonad^le  cost,  in  a  timely  manner.  Our  customers  are  not 
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necessarily  interested  in  the  details  of  DLA's  processes/initiatives  for 
achieving  this-  DLA  has  the  responsibility  to  create/implement  the 
processes/programs  to  meet  the  users ' /customers *  requirements  and 
expectations.  The  needs  of  our  customers  were  foremost  in  developing 
many  of  the  initiatives  in  the  May  90  Action  Plan.  The  fact  that  we  had 
an  Action  Plan  to  improve  quality  did  not  enhance  our  customers' 
satisfaction  with  our  performance.  In  fact,  the  Military  Services,  our 
major  customers,  were  creating  similar  Action  Plans.  Ultimately,  nearly 
all  of  our  initiatives  directly  touched  our  customers  through  joint 
participation  or  better  quality  of  spare  and  repair  parts.  Therefore, 
DIA  does  not  plan  to  solicit  feedback  for  the  initiatives  in  the  new  OLA 
Action  Plan  from  the  users  of  spare  and  repair  parts.  DLA  will, 
however,  again  provide  copies  of  its  new  Action  Plan  to  the  Action 
Plan  Points  of  Contact  in  the  Army  Materiel  Command,  the  Naval  Supply 
Systems  Command,  and  the  Air  Force  Materiel  Command  for  awareness  and 
any  feedback  relating  to  initiatives. 

finding  B:  Adequacy  of  Implementing  Action  Plans.  The  DoD  Components 
did  not  have  complete  implementing  action  plans  because  changes  were  not 
initiated  to  add,  delete,  and  revise  the  objectives  and  the  supporting 
initiatives  related  to  pre-contract,  contract,  contract  administration, 
depot  (supply  management),  and  feedback  intelligence  phases  of  the  action 
plans.  Consequently,  the  implementing  action  plans  did  not  reflect 
current  quality  program  objectives  and  initiatives  and  were  not  used  as  a 
management  tool  for  continuously  improving  the  quality  of  spare  and 
repair  parts. 

DLA  COMMENTS:  *  Nonconcur,  DLA  developed  an  automated  means  for  Offices 
of  Primary  Interest  (OPIs)  to  add,  delete,  and  revise  objectives  and 
supporting  , initiatives  in  the  DLA  Action  Plan.  This  system,  within  the 
Distributive  Miniature  Information  System  (DMINS) ,  provided  for  entry  of 
each  objective/initiative  with  the  original  milestones.  Periodically, 
each  OPI  was  responsible  to  place  updated  information  into  the  system 
(data  entry  was  restricted  to  OPIs  to  maintain  the  integrity  of  the 
system)  «  Printouts  of  the  periodic  updates  show  that  revisions  were 
made  to  objective,  initiatives,  performance  measures,  and  milestones  in 
each  area  and  that  these  revisions  reflected  current  quality  program 
objectives  and  initiatives.  Other  OPIs  and  DLA  management  officials  were 
provided  inquiry  capability  which  they  used  to  review  the  status  of 
activities. 

The  DLA  Deputy  Director  used  this  system  to  monitor  actions,  and 
routinely  printed  out  specific  initiatives  with  his  comments  and 
questions  for  OPIs  to  answer. 

Periodic  briefings  on  the  status  of  DLA's  Action  Plan  initiatives  were 
provided  to  the  DLA  Director,  Deputy  Director,  and  Principal  Staff 
Element  (P5E)  heads.  The  briefings  included  objectives,  supporting 
initiatives,  performance  measures,  and  milestones  with  changes  and 
updates  as  applicable. 

Documents .  from  the  above  actions  show  that  DLA  did  use  the  DLA  Action 
Plan  as  a  management  tool  for  continuously  improving  the  quality  of  spare 
and  repair  i)art8. 
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DISPOSITION: 

(  )  Action  is  ongoing.  Estimated  Completion  Date: 

(X)  Action  is  considered  cootplete. 

INTERNAL  MANAGEMENT  CC^ITROL  WEAKNESSES:  (Z)  Nonconcur.  (Rationale  must 
(X)  Nonconcur.  (Rationale  must  be  docuiDented  and  maintained  with  your 
copy  of  the  response.) 

i  }  Concur;  however,  weakness  is  not  considered  material.  (Rationale 
must  be  documented  and  maintained  with  your  copy  of  the  response.) 
(  )  Concur;  weakness  is  material  and  will  be  reported  in  the  DLA 
Axmual  Statement  of  Assurance. 


MONETARY  BENEFITS:  N/A 
PLA  COMMENTS :  N/A 
ESTIMATED  REALIZATION  DATE; 
AMOUNT  REALIZED:  N/A 
DATE  BENEFITS  REALIZED:  N/A 


ACTION  OFFICER;  Duane  Rice^  MMSLP,  617-050S,  17  Dec  93 
REVIEW/APPROVAL:  James  J.  Grady,  Jr.,  Deputy  Executive  Director,  Supply 
Management,  MMSD,  x70S10,  1/26/94 
COORDINATION;  AQCO  /***>/ ^» 

A.  Broadnax,  DDAI,  x49607,  2/1/94 


DLA  APPROVAL; 


2  2  f£3  19S4 


LAVRENC3  P.  FARRELL.  JA, 
UG)or  GencnJ,  tJSAP 
Principal  Deputy  ViMtot 
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RECOMMENDATION  B.2.a:  We  recommend  that  the  Asaietant  Secretaries  of 
the  Army  and  Navy  (Research,  Development,  and  Acquisition),  the 
Assistant  Secretary  of  the  Air  Force  (Acquisition) ,  and  the  Director, 
Defense  logistics  Agency,  update  their  implementing  action  plans  to 
show  the  current  or  planned  actions  to  maintain  technical  data  packages 
and  make  them  available,  adequate,  and  accurate  as  an  initiative  for 
objective  2,  ensure  technical  data  are  available,  adequate,  and 
accurate  for  use  in  acquiring  quality  parts. 

DLA  COMMENTS:  Concur.  DLA  has  determined  that  additional  actions 
are  needed  to  continue  the  initiative  to  objective  2.  DLA  has 
included  this  rewritten  initiative  in  the  new  action  plan  to  study  and 
improve,  as  necessary,  the  processes  for  measuring  and  assuring  the 
accuracy  and  adequacy  (quality)  of  technical  data  used  In  DLA 
contracting. 


RECOMMENDATION  B.2.b:  We  reconunend  that  the  Assistant  Secretaries  of  the 
Army  and  Navy  (Research,  Development,  and  Acquisition)  ,  the  Assistant 
Secretary  of  the  Air  Force  (Acquisition) ,  and  the  Director,  Defense 
Logistics  Agency,  update  their  implementing  action  plans  to  show  the 
current  or  planned  actions  to  comply  with  the  requirements  of  Office  of 
Federal  Procurement  Policy  Letter  No.  91-3,  "Reporting  Nonconforming 
Products,"  to  participate  in  the  Government -Industry  Data  Exchange 
Program  as  an  initiative  for  objective  23,  improve  the  customer  complaint 
system. 

DLA  COMMENTS;  Nonconcur,  DLA  already  participates  in  the 
Government -Indus try  Data  Exchange  Program  (GIDEP)  within  both  the  DIA 
Inventory  Control  Points  (ICPs)  and  the  Defense  Contract  Management 
Districts  (DCMDs)  .  DLA  did  have  a  GIDEP  initiative  in  the  DLA  Action 
Plan,  (Objective  18b) ,  and  took  action  to  establish  the  use  of  GIDEP  as  a 
feedback  means  to  identify  suspect  parts.  Under  the  DLA  Action  Plan, 
GIDEP  reporting  policy  was  included  in  the  Joint  Regulation,  DLAR 
4155.24,  Product  Quality  Deficiency  Report  Program,  and  In  DLAM  8200.5, 
In-Plant  Quality  Evaluation  (IQUE) . 

Policy  to  use  GIDEP  is  also  in  the  DLAM  4155.2,  Quail ity  Assurance  Program 
Manual  for  Inventory  Control  Points  (Defense  Supply  Centers)  .  Training 
on  the  use  of  GIDEP  is  provided  in  Course  "S61",  a  mandatory  course  for 
Quality  Assurance  personnel  at  the  DLA  Supply  Centers.  DLA  is  also 
participating  in  training  provided  by  the  GIDEP  Operations  Center, 

Corona,  CA. 

The  draft  report  states  that  "the  extent  of  [GIDEPI  participation  is  not 
measured."  DLA  does  measure  participation  through  utilization  reports 
from  the  GIDEP  system  and  through  recurring  cost/benefit  reports. 

Since  the  use  of  GIDEP  is  already  institutionalized  within  DIA, 
additional  GIDEP  initiatives  are  unnecessary. 
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RECOMMENDATION  B.2.C:  We  recommend  that  the  Assistant  Secretaries  of  the 
Army  and  Navy  (Research,  Development,  and  Acquisition)  ,  the  Assistant 
Secretary  of  the  Air  Force  (Acquisition) ,  and  the  Director,  Defense 
Logistics  Agency,  update  their  implementing  action  plans  to  shov  the 
current  or  planned  actions  to  support  the  development,  planned 
deployment,  and  implementation  of  the  DoD-wide  Deficiency  Reporting 
System  as  an  initiative  for  objective  23,  improve  the  customer 
complaint  system. 

DLA  COMMENTS:  Concur.  DLA  agrees  that  additional  actions  are  needed  to 
continue  the  initiative  to  objective  23.  DLA  has  included  this  rewritten 
initiative  in  the  new  DLA  Action  Plan.  An  initiative  entitled,  "Improve 
the  Product  Quality  Deficiency  Report  (PQDR)  Processes /Program  by 
Supporting  the  Joint  Logistics  Systems  Center's  (JLSC's)  Development  and 
Deployment  of  a  DoD-wide  Deficiency  Reporting  System  (ORS)  that 
Effectively  Serves  the  Mission  Needs  of  DLA",  is  included  in  the  new  DLA 
Action  Plan.  This  initiative  outlines  DLA's  support  from  the  beginning 
of  the  DRS  and  continuing  involvement  in  the  DRS  through  DLA  deployment. 
It  also  includes  the  update  of  the  Joint  Services  Regulation  for  PQDRs 
(DLAR  4155.24).  An  internal  control  weakness  does  not  exist. 


RECOMMENDATION  B.2.d:  We  recommend  that  the  Assistant  Secretaries  of  the 
Army  and  Navy  (Research,  Development,  and  Acquisition),  the  Assistant 
Secretary  of  the  Air  Force  (Acquisition) ,  and  the  Director,  Defense 
Logistics  Agency,  update  their  implementing  action  plans  to  show  the 
current  or  planned  actions  to  reduce  the  nur=ber  of  forms  used  to  report 
nonconformances,  and  standardize  the  forms  and  the  use  of  the  forms  as 
initiatives  for  objective  23,  improve  the  customer  complaint  system. 

DLA  COMMENTS:  Nonconcur.  A  direct  result  of  the  development  and 
deployment  of  the  DoD  Deficiency  Reporting  System  (DRS)  is  the 
standardization  of  the  data  content  and  the  use  of  nonconformance 
reporting  formats  and  a  significant  reduction  in  the  use  of  paper  forms. 
The  primary  focus  for  improvement  of  the  customer  complaint  system  is  the 
DoD  DRS.  The  Logistics  Management  Institute  (U<I)  analysis  and 
recommendations  documented  in  LMI  Report  DL902R2/Sep  91,  "The  Feasibility 
of  a  Single  Discrepancy  Reporting  System,"  supported  the  integrated 
automation  of  all  types  of  discrepancy  reporting  at  both  the  retail  and 
wholesale  levels.  DoD  is  realizing  this  goal  under  the  DoD  DRS.  Phase  1 
of  the  DRS  will  be  operational  in  1994  and  will  include  both  supply  and 
product  quality  discrepancies.  Phase  2  will  compoxand  the  benefits  of 
standardization  and  reduction  in  the  use  of  paper  forms  by  including 
transportation  discrepancy  reporting  as  well  as  electronic  data 
interchange  capability  using  American  National  Standards  Institute  X12 
industry  standards.  With  these  DoD  DRS  initiatives,  there  is  no  need  to 
detail  specific  items  in  the  DLA  Action  Plan,  objective  23,  concerning 
elimination  and  standardization  of  forms  used  to  report  nonconformances. 
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RECOMMENDATION  B,2.e:  He  recommend  that  the  Aasistant  Secretaries  of  the 
Army  and  Navy  (Research,  Development,  and  Acquisition) ,  the  Assistant 
Secretary  of  the  Air  Force  (Acquisition) ,  and  the  Director,  Defense 
Logistics  Agency,  update  their  implementing  action  plans  to  show  the 
current  or  planned  actions  to  provide  the  training  needed  to  verify  that 
the  Product  Quality  Deficiency  Reports  Program  is  used  effectively  as  an 
Initiative  for  objective  23,  improve  the  customer  complaint  system. 

DLA  COMMENTS:  Nonconcur.  Under  the  DLA  Action  Plan,  extensive  training 
initiatives  were  ta)cen  regarding  the  PQDR  program.  To  encourage  retail 
level  reporting  of  deficiencies,  DLA  developed  a  handboo)c  providing 
instructions  on  how  to  complete  PQDR  forms.  DLA  representatives  directly 
trained  Military  Service  users  during  Customer  Supply  Assistance  visits 
to  Military  Service  locations. 

A  review/analysis  of  the  Product  Quality  Deficiency  Reporting  (PQDR) 
system  was  conducted  through  meetings  and  worJcshops  of  the  DoD  QA 
Council's  Ad  Hoc  PQDR  Wor)cing  Group  consisting  of  representatives  from 
the. Military  Services  and  GSA.  The  DLA  representative  chaired  this 
group.  A  revised  Joint  Service  Regulation,  DLAR  41SS.24,  Product  Quality 
Deficiency  Report  Program,  was  issued.  Specific  training  in  new 
requirements  of  the  Joint  PQDR  Regulation  (published  Jul  93)  has  been 
accomplished.  Training  in  the  new  DoD  Deficiency  Reporting  System 
(DoD-DRS)  has  been  scheduled  to  coincide  with  deployment  of  the  system. 

DLA  also  developed/published  implementing  policy  for  Defense  Contract 
Management  Command  elements  in  Appendix  A  of  DLAR  4155.24. 

Some  other  initiatives  included:  standardized  summary  cause  (of 
deficiency)  codes;  initiating  programming  requests  to  add  cause  codes  to 
DLA/DCMC  computer  systems;  standardizing  electronic  transmission  format 
for  PQDR  Form  (SF  368  Form)  and  DLA  Form  1227. 

Within  the  DLA  initiative,  reports  were  provided  to  Military  Services  on 
lac)c  of  exhibits  and  training  guidance  was  provided  to  Military  Service 
Screening  Points  on  how  to  better  perform  their  responsibilities.  To 
train  DLA  personnel,  a  "How  to  Handbook*  was  developed  and  used  as  a 
process  guide.  DLA  Deficiency  Program  Monitors  conducted  system  training 
using  the  guide. 

As  a  result  of  accomplishments  in  the  DLA  Action  Plan,  as  well  as 
previous/subsequent  additions  of  initiatives,  DLA  has  institutionalized 
PQDR  training.  Basic  PQDR  and  Customer  Depot  Complaint  System 
instruction  modules  have  been  included  in  the  core  training  courses 
(i.e..  Course  *861",  Defense  Supply  Center  Contract  Quality  Assurance) . 

Additional  initiatives  for  PQDR  training  are  unnecessary  at  this  time. 
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RECX)MMENDATION  B.3.a;  We  recommend  that  the  Assistant  Secretaries  of 
the  Army  and  Navy  (Research,  Development,  and  Acquisition)  ,  the  Assistant 
Secretary  of  the  Air  Force  (Acquisition) ,  and  the  Director,  Defense 
Logistics  Agency,  revise  their  implementing  action  plans  to  support 
an  effort  to  identify  and  designate  one  system  as  the  standard  DoD 
vendor  rating  system  as  part  of  an  additional  objective  to  the 
pre-contract  phase. 

DLA  CX)MMENTS:  Nonconcur.  The  Federal  Acquisition  Regulation  (FAR) 
delegates  source  selection  responsibilities  to  the  Agency  heads  or  their 
designees.  This  authority  gives  agency  officials  considerable  discretion 
in  specifying  a  solicitation’s  evaluation  factors,  the  relative 
importance  of  those  factors,  and  the  way  in  which  those  factors  will  be 
evaluated.  A  standard  vendor  rating  system  would  unduly  limit  the 
agency’s  authority  and  operational  flexibility,  and  have  an  adverse 
impact  on  overall  effectiveness. 

The  nature  of  supplies  and  services  DoD  buys  is  so  diverse  that 
specifying  a  single  vendor  rating  system  would  be  as  inappropriate  as 
specifying  only  one  contract  type  or  solicitation  type.  The  need  for 
flexibility  in  structuring  past  performance  evaluation  systems  was 
recognized  in  Office  of  Federal  Procurement  Policy  (OFPP)  Policy  Letter 
92-5,  which  establishes  best  value,  using  past  performance  data,  as  the 
preferred  method  of  negotiated  procurement.  Flexibility  was  a  key  topic 
in  both  the  public  and  agency  comment  process,  and  has  been  emphasized 
by  OFPP  Administrator  Kelman  in  his  public  statements  supporting  the 
goals  of  the  policy  letter. 

Flexibility  is  needed  not  only  to  reflect  the  different  needs  of  the 
buying  activities,  but  also  their  different  capabilities  in  obtaining  and 
evaluating  past  performance  information.  We  note  that  the  Navy’s 
Red/Yellow/Grcen  program  is  a  very  simplistic  best  value  system  which  is 
limited  in  its  ability  to  make  distinctions  among  offerors  (although  it 
appears  to  meet  the  Navy’s  needs).  The  same  can  be  said  for  DLA’s 
Quality  Vendor  Program  (QVP)  ,  QVP  was  a  first  step  in  applying  best 
value  to  smaller  dollar  value  procurements,  which  reflected  our  limited 
ability  to  compile  and  evaluate  past  performance  data  at  the  time  of  its 
development.  Our  Automated  Best  Value  Model  (ABVM)  is  a  much  more  useful 
and  sophisticated,  second -generation  system  which  reflects  a  significant 
improvement  in  our  data  evaluation  systems  and  capabilities.  It  may  not 
be  suitable  or  possible  for  all  buying  activities  to  adopt  such  a  system. 

The  adoption  of  a  single,  uniform  best  value  system  would  limit  all 
activities  to  the  capabilities  of  the  least  capable.  It  would  also 
increase  the  time  necessary  to  implement  enhancements  to  best  value 
systems  and  slow  the  progression  to  more  sophisticated  and  capable 
systems.  While  we  agree  with  the  IG  that  the  use  of  past  performance 
in  best  value  procurement  is  a  useful  tool  to  improve  contractor 
quality  performance,  we  believe  that  the  recommendation  will  have  exactly 
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the  opposite  effect  by  limiting  the  use  and  improvement  of  best 
value  techniques. 

The  IG  states  that  suppliers  have  complained  about  the  confusion  in 
satisfying  the  varying  requirements  for  numerous  rating  systems.  This 
has  not  been  our  experience  with  the  Quality  Vendor  Program,  under  which 
each  DLA  Supply  Center  has  established  its  cvn  criteria  for  quality 
vendors,  and  which  has  been  in  use  since  198S.  While  there  are  specific 
qualification  requirements  that  contractors  Tcust  fulfill  In  order  to  be 
designated  quality  vendors,  this  will  not  apply  under  ABVM,  where  all 
contractors  will  receive  a  performance  score. 

A  distinction  must  also  be  drawn  between  the  rating  of  a  contractor's 
performance  under  a  specific  contract  and  the  use  of  past  performance 
information  in  a  best  value  system  which  establishes  a  rating  for  the 
offeror  for  that  procurement  only.  DLA's  ABVM  will  use  objective  past 
performance  data  to  generate  a  performance  score  (rating)  for  use  in 
source  selection.  This  rating  is  updated  monthly  and  does  not  stay  with 
the  contractor's  record.  Standardization  of  ratings  for  contractor 
performance  under  a  specific  contract  is  a  v-alid  goal  and  is  being 
pursued  by  the  Past  Performance  Coordinating  Council.  For  the  most  part, 
however,  definitions  for  the  objective  perfcrmance  data  elements  used  for 
the  ABVM  (e.g.,  product  quality  deficiency)  are  already  standardized 
throughout  DoD. 

RECOMMENDATION  B.3.b:  We  recommend  that  the  Assistant  Secretaries  of  the 
Army  and  Navy  (Research,  Development,  and  Acquisition),  the  Assistant 
Secretary  of  the  Air  Force  (Acquisition),  and  the  Director,  Defense 
Iiogistics  Agency,  revise  their  implementing  action  plans  to  describe  the 
actions  taJcen  to  comply  with  United  States  Code,  title  10,  section  2383, 
"Procurement  of  Critical  Aircraft  and  Ship  Parts,"  as  an  initiative  for 
objective  7,  ensure  all  suppliers  of  spare  and  repair  parts  meet 
specified  quality  and  technical  requirements. 

DLA  COMMENTS:  Nonconcur.  DoD  is  recommending  repeal  of  10  U.S.C.  S  2383 
in  accordance  with  a  Section  800  Panel  recommendation.  The  10 
nevertheless  recommends  that  the  components  should  revise  objective  7  to 
comply  with  a  potentially  defunct  law.  In  our  view,  this  thwarts  the 
purpose  of  the  Section  800  recommendation,  with  which  we  are  in 
agreement.  Furthermore,  in  1989  the  DAR  Council  determined  that  the 
statute  was  directed  at  program  managers,  rather  than  at  contracting 
officers,  essentially  removing  DLA  from  involvement  in  this  issue.  For 
this  reason,  the  IG's  recommendation  is  inappropriate  insofar  as  it 
pertains  to  us.  And,  as  the  DAR  Council  Director  noted  four  years  ago. 
quality  assurance  procedures  already  available  to  DoD  are  adequate;  the 
law  in  question  does  not  provide  2my  additional  protections  to  the 
Government . 
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RECOMMENDATION  B.3.C:  We  recommend  that  the  Assistant  Secretaries  of  the 
Array  and  Navy  (Research,  Development,  and  Acquisition),  the  Assistant 
Secretary  of  the  Air  Force  (Acquisition),  and  the  Director,  Defense 
Ijogistics  Agency,  revise  their  implementing  action  plans  to  support 
development  of  contractual  policy  proposals  to  obtain  reimbursement  or 
replacement  for  products  accepted  by  the  Government,  but  later  found 
to  contain  patent  defects,  as  an  initiative  for  objective  6,  reject  or 
require  corrections  of  nonconforming  supplies. 

DLA  COMMENTS:  Partially  concur.  DLA  has  determined  that  additional 
actions  are  needed  to  continue  the  initiative  to  objective  6.  OLA  has 
included  this  rewritten  initiative  in  the  new  action  plan.  The  outcome 
of  discussions  with  the  Office  of  the  Director  of  Defense  Procurement 
(DDP) ,  DoDIG,  and  DLA  was  that  we  should  devise  a  means,  to  be 
io^lemented  on  a  test  basis,  whereby  contractors  may  be  held  accountable 
for  patent  nonconformances  discovered  after  acceptance  for  certain 
designated  federal  supply  classes  (FSCs) -  (The  test  FSCs  were  selected 
because  they  had  yielded  high  or  disproportionate  rates  of  nonconformance 
in  the  recent  past.)  For  the  duration  of  the  test,  contracting  officers 
would  include  a  special  DLA  clause,  •Remedies  for  the  Post -Acceptance 
Discovery  of  Nonconformances  (Test),*  in  all  contracting  actions  for 
these  designated  classes  of  items,  in  accordance  with  guidance  proposed 
to  be  included  in  the  DLA  Acquisition  Regulation.  The  clause  would  give 
the  Government  the  authority  to  require  contractors  to  repair,  replace, 
or  make  reimbursement  for  nonconforming  items  for  one  year  after 
acceptance.  The  DLA  Lab  Testing  Program  would  be  used  to  uncover 
nonconformances,  to  support  determinations  of  contractor  causation,  and 
to  identify  defects  as  "latent"  or  •patent.* 

Because  the  proposed  clause  and  coverage  are  deviations  from  the  FAR 
which  will  have  a  significant  impact  on  the  public,  it  will  be  necessary 
to  publish  a  proposed  rule  in  the  Federal  Register.  Subsequent  to  the 
public  comment  period  and  reconciliation  of  any  issues  identified 
thereby,  the  DLAR  coverage  will  be  published  as  a  final  rule  and  made 
available  for  use.  The  test  will  require  at  least  three  years  from  the 
date  when  coverage  will  begin  to  be  included  in  contracting  actions,  in 
order  for  a  determination  to  be  made  whether  the  benefits  of  changing  the 
acceptance  procedures  have  outweighed  the  costs  of  the  change.  We  will 
use  nonconformances  and  voluntary  refund  data  from  the  12  month  period 
immediately  preceding  the  start  of  the  test  as  the  baseline  for 
measurement  and  comparison. 

Clearly,  this  test,  which  is  being  made  a  part  of  DLA's  revised  Action 
Plan,  is  an  adequate  response  to  the  IG's  recomnendation.  If  the  test 
plan  is  approved  and  the  test  is  successful,  there  is  the  potential  that 
use  of  the  clause  and  technique  will  be  expanded  to  other  FSCs/Centers. 
Since  this  is  such  a  comprehensive  response,  we  do  not  feel  that 
objective  8  of  the  Action  Plan  should  be  revised  to  include  any  other 
contractual  initiatives  (other  than  a  reemphasis  on  voluntary 

recoupments)  regarding  rejection  or  correction  of  nonconformances. 
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R£CX>MKENDATION  B.3.d:  We  recommend  that  the  Assistant  Secretaries  of  the 
Army  and  Navy  (Research,  Development,  and  Acquisition),  the  Assistant 
Secretary  of  the  Air  Force  (Acquisition),  and  the  Director,  Defense 
Logistics  Agency,  revise  their  implementing  action  plans  to  remove 
nonconforming  products  identified  on  Product  Quality  Deficiency  Reports 
from  Defense  Supply  system  inventories;  notify  contractors  when  their 
nonconforming  products  are  discovered  and  provide  copies  of  quality 
deficiency  information  to  contractors  so  the  contractor  can  correct  the 
cause  of  the  quality  control  failure;  inform  contracting  officers  so  they 
can  attempt  to  recoup  the  value  of  the  nonconforming  products;  and 
document  the  quality  assurance  decisions  to  request  or  not  request 
la)x>ratory  testing  needed  to  support  Product  Quality  Deficiency  Report  as 
initiatives  for  objective  23,  improve  the  customer  complaint  system. 

DLA  COMMENTS:  Nonconcur.  As  noted  in  the  draft  IG  audit  report,  the  IG, 
DoD  Report  No.  93-066M  "Recoupments  for  Quality  Defects"  contained 
findings  and  recommendations  as  identified  above.  As  a  result  of  that  IQ 
report,  DLA  took  action  to  correct  the  problem  with  the  issuance  of  a 
policy  letter  that  provided  procedures  to  resolve  the  above  problems. 
Training  on  the  new  procedures  was  accomplished  at  the  Defense  Supply 
Centers.  The  provisions  of  this  policy  letter  were  incorporated  into  the 
revised  DLAM  4155.2,  Quality  Assurance  Program  Manual  for  DSCs,  which  has 
been  submitted  for  publication  October  1993 .  HQ  DLA  has  already 
performed  a  Quality  Management  Review  at  the  Defense  General  Supply 
Center,  Richmond,  VA  and  confirmed  that  the  revised  procedures  have  been 
incorporated  within  their  processes  and  have  corrected  the  situation 
originally  reported  by  the  DoD  IG. 

Since  DLA  has  already  taken  corrective  action  regarding  the  finding,  and 
has  institutionalized  the  specific  recommendations  made  a]:^ve,  we  see  no 
benefit  for  DLA  to  place  a  new  initiative  in  the  Action  Plan. 

RECOMMENDATION  B,3.e:  We  recommend  that  the  Assistant  Secretaries  of  the 
Army  and  Navy  (Research,  Development,  and  Acquisition),  the  Assistant 
Secretary  of  the  Air  Force  (Acquisition) ,  and  the  Director,  Defense 
Logistics  Agency,  revise  their  implementing  action  plans  to  develop 
strategies  for  cost  effectively  targeting  quality  assurance  laboratory 
testing  to  identify  susceptible  product  lines  and  problem  contractors, 
and  to  randomly  test  the  products  supplied  by  problem  suppliers  at  every 
national  inventory  control  point  as  an  added  objective  for  the  feedback 
intelligence  phase. 

DIiA  COMMENTS:  Nonconcur.  The  May  90  DLA  Action  Plan  included 

laboratory  testing  as  a  key  component  of  improving  the  quality  of  spare 
and  repair  parts.  Many  initiatives  and  tasks  were  included  with 
appropriate  milestones  and  measures.  These  initiatives  were  tracked 
within  the  DLA  Automated  Action  Plan  with  new  initiatives,  ta8)cs, 
milestones  and  measures  added  since  the  May  90  DLA  Action  Plan  was 
published. 

Additional  laboratory  testing  actions  accoteplished  include: 

Developed/  issued  corporate  laboratory  testing  policies  through 
DLAR  4105.20,  "Contractor  Assessment -Product  Evaluation  (CAPE)"  and  DLAR 
8200.12,  "DCMC  Independent  Lab  Testing  (ILT)  «  regulations. 

Institutionalized  the  Laboratory  Testing  Program  at  all  DLA 
Hardware  Centers. 
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Identified  DLA  testing  equipment  and  DLA/Military 
Services/commercial  laboratory  capabilities  and  obtained  additional  test 
equipment  for  DLA's  existing  laboratories  to  enhance  capacity  and 
capabilities. 

Established  organic  laboratories  at  Defense  Distribution  Region 
East,  Defense  Distribution  Region  West,  Defense  Construction  Supply 
Center,  and  Defense  General  Supply  Center. 

Developed/published  "The  DLA  Internal  Laboratory  Testing  Program", 
DIAM  4155.9,  to  provide  Agency  policy  and  procedural  guidance  regarding 
how  to  establish,  operate,  and  maintain  DLA  laboratories. 

Established  testing  support  arrangements  with  Sacramento  ALC,  Ogden 
ALC,  Aberdeen  Proving  Ground  and  other  Military  Service  laboratories. 

Developed  functional  requirements  for  a  Laboratory  Information 
Management  System  (LIMS) . 

Developed  an  Automated  Test  Reporting  System  (System  for  Analysis 
of  Laboratory  Testing)  . 


Shared  laboratory  testing  data  with  military  services  and  Industry. 

Developed/ implemented  sampling  programs  (San^ling  Assistance  Model 
and  Stratified  Sampling  Plan)  for  determining  random  laboratory  testing 
candidates . 

Completed  a  Laboratory  Training  Analysis  to  identify  specific 
training  needs  of  laboratory  personnel. 

Initiated  program  for  the  Third  Party  accreditation  of  DIA 
laboratories . 

Developed/provided  test  plan  guidance  for  DIA  Supply  Centers  to 
assist  them  in  preparation  of  test  plans. 

The  draft  proposed  IG  audit  report.  Project  No.  2CF-0053  "DoD  Coa^nent 
Implementing  Action  Plans  For  Improving  The  Quality  Of  Spare  Parts"  cited 
the  Defense  Industrial  Supply  Center's  (DISC)  vast  improvement  in  its 
product  conformance  rate  over  the  past  three  years.  Part  of  this 
improvement  is  directly  attributed  to  DISC'S  development  of  a  coat 
effective  quality  assurance  led^oratory  testing  program  that  identifies 
and  tests  suspect  federal  supply  clasaes/groups  and  problem  contractors. 
Each  of  DLA's  national  inventory  control  points  (ICPs)  has  a  laboratory 
testing  program  that  supports  our  product  quality  program  by  cost 
effectively  targeting  and  testing  suspect  contractors  and  materiel. 
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DliA  Regulation  4105.20,  "CAPE*  and  DLAM  4155.2,  "Quality  Assurance 
Program  Manual  for  Defense  Supply  Centers"  emphasize  the  use  of 
laboratory  testing  as  a  major  component  to  building  quality  history  data 
on  contractors.  This  additional  contractor  quality  history  directly 
supports  improved  contracting  initiatives  such  as  "Best  Value"  and 
provides  each  ICP  with  contractors/materiels  that  require  increased 
quality  assurance  surveillance/scrutiny  to  include  laboratory  testing  as 
appropriate.  Laboratory  testing  includes  samples  selected  randomly 
or  nonrandomly.  Random  testing  provides  both  a  measure  of  the  quality 
of  new  procurements  and  detection  of  poor  performing  contractors. 

Random  candidates  for  testing  are  selected  by  ICPs  using  the  DLA 
Sampling  Assistance  Model  {SAM)  or  similar  method.  Nonrandom 
testing  is  a  powerful  quality  assurance  tool  to  investigate  materiel 
deficiencies,  suspect  contractors,  and  problem  products/product  lines. 

HQ  DLA  performs  staff  assistance  visits  to  the  ICPs  to  evaluate  the 
effectiveness  of  the  laboratory  testing  program.  The  most  recent  Quality 
Management  Review  (QMR)  at  the  Defense  General  Supply  Center,  Richmond, 

VA  verified  the  effectiveness  of  their  laboratory  testing  program.  QMRs 
also  provide  a  means  to  improve  DLA  policy  with  regards  to  the  use  of 
laboratory  testing. 


RECOMMENDATION  B.3.f;  We  recommend  that  the  Assistant  Secretaries  of  the 
Army  and  Navy  (Research,  Development,  and  Acquisition),  the  Assistant 
Secretary  of  the  Air  Force  (Acquisition) ,  and  the  Director,  Defense 
Logistics  Agency,  revise  their  implementing  action  plans  to  evaluate  the 
adequacy  of  quality  assurance  laboratory  test  plans  as  an  initiative  for 
objective  22,  enhance  the  use  of  DoD  and  independent  laboratory  test 
capabilities . 

DLA  COMMENTS:  Nonconcur.  DLA  quality  assurance  laboratory  test  plans 

are  adequate  to  determine  whether  an  item/materiel  conforms  to 
contractual  requirements.  DLA  Regulation  4105.20,  "Contractor 
Assessment -Product  Evaluation"  and  DLAM  4155.2,  "Quality  Assurance 
Program  Manual  for  Defense  Supply  Centers"  both  provide  guidance  to  the 
Inventory  Control  Points  (ICPs)  regarding  the  development  of  test  plans 
and  the  use  of  Government  and  commercial  laboratory  test  capabilities. 

In  Feb  93,  representatives  from  each  ICP  attended  a  laboratory  test 
plan  workshop  hosted  by  HQ  DLA  to  further  refine  the  current  test  plan 
guidance.  Each  ICPs*  methods  for  developing  test  plans  for  their 
specific  items/commodities  were  reviewed  in  detail  and  found  to  be 
adequate , 

HQ  DLA  performs  periodic  staff  assistance  visits  to  the  ICPs  which 
includes  the  evaluation  of  the  effectiveness  of  the  laboratory  testing 
program.  The  most  recent  Quality  Management  Review  (C^)  at  the  Defense 
General  Supply  Center,  Richmond,  VA  in  Nov  93  verified  the  adequacy  of 
their  quality  assurance  laboratory  test  plans.  HQ  DLA  will  conduct 
similar  QMRs  at  each  ICP  to  continually  evaluate/ improve  the  adequacy  of 
laboratory  test  plans. 
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RECOMMENDATION  B.S.a:  We  recommend  that  the  Director,  Defense  Logistics 
Agency,  revise  the  Defense  Logistics  Agency  Action  Plan  to  add  an 
objective  to  develop  the  Contractor  Profile  System  in  the  pre-contract 
phase. 

DLA  COMMENTS:  Concur.  DLA  has  determined  that  additional  actions  are 
needed  to  continue  the  initiative  to  objective  23.  DLA  has  included 
this  rewritten  initiative  in  the  new  action  plan. 


A  Contractor  Profile  System  (CPS)  has  been  developed  for  DLA  and  it  has 
been  deployed  in  the  Defense  Contract  Management  Districts.  CPS  accesses 
contractor  past  performance  information  from  existing  DLA  data  bases,  and 
is  available  to  support  procurement  and  contract  administration  functions 
including  the  determination  of  best  value  award  decisions.  Contractor 
past  performance  information  is  accessed  through  CPS  by  entering  a 
Contractor  and  Government  Entity  code. 


Contractors  will  be  given  access  to  their  own  CPS  information  for 
validation  and  as  an  incentive  to  improve  performance.  Deployment  of  CPS 
within  DLA,  contractor  access,  and  limited  access  by  the  Military 
Services  is  scheduled  for  completion  by  March  1994.  In  Peb  94, 
deployment  of  CPS  will  be  completed  at  the  DLA  Inventory  Control  Points. 
The  Military  Services  are  preparing  to  evaluate  CPS  in  early  1994  to 
determine  if  the  system  meets  their  needs  and  if  further  enhancements  are 
necessary. 


RECOMMENDATION  B.S.b;  We  recommend  that  the  Director,  Defense  Logistics 
Aaencv.  revise  the  Defense  Logistics  Agency  Action  Plan  to  add  an 
initiative  to  measure  and  describe  the  progress  of  all  ^D 
in  the  In-Plant  Quality  Evaluation  Program  under  objective  14,  measure 
effectiveness  of  in-plant  Government  contract  administration  and 
contractor  performance. 

DLA  COMMENTS;  Nonconcur.  The  In-Plant  Quality  Evaluation  (IQUE) 

Maturity  Levels  were  never  intended  as  a  measure  of  contractor  progress. 
They  were  to  be  used  by  DCMC  QARs  in  performing  self-assessments  of  ^eir 
own  IQUE  programs.  Furthermore,  IQUE  Maturity  Levels  were  to  ^ 

ineffective  and  were  cancelled  by  HQ  DCMC  in  May  93.  Process  Oriented 
Contract  Administration  Services  (PROCAS) ,  a  multi-functional  process 
improvement  approach,  is  replacing  IQUE,  PROCAS  is  intended  ^ 
increased  communication  among  DCMC,  customers,  industry, 
the  aoolication  of  given  guidelines  and  direct  measurement  of  contractor 
processes.  PROCAS  provides  visibility  of  objective  data  in  order  to  make 
informed  decisions.  By  crossing  functional,  business,  and  technical 
boundaries,  PROCAS  provides  a  seamless  approach  to  contract 
administration. 


Fbal  Report 


Revised 
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RECOMMENDATION  B.5.C:  We  reconunend  that  the  Director,  Defense  Iiogistice 
Agency,  revise  the  Defense  Logistics  Agency  Action  Plan  to  add  an 
objective  to  implement  the  commercial  quality  standards  that  are 
described  in  the  International  Organization  for  Standardization  (ISO) 

9000  series  and  equivalent  American  National  Standards  Institute  American 
Society  for  Quality  Control  (ANSI/ASQC  Q90)  quality  system  series. 

DLA  COMMENTS;  Nonconcur.  The  Defense  Logistics  Agency  is  prohibited 
from  implementing  the  ISO  9000  series  and  equivalent  ANSI/ASQC  Q90  on 
supply  center  contracts.  On  2  Apr  93,  ASD  (PaL)  memo  authorized  the  use 
of  ISO  9001  or  ISO  9002  in  lieu  of  MIL-Q-9858A;  but  prohibited  the  use  of 
ISO  standards  in  lieu  of  MIL-I-45208A.  DLA  supply  centers  do  not  apply 
MIL-Q-98S8  on  their  contracts;  the  highest  level  quality  system  standard 
that  we  use  on  spare  and  repair  parts  contracts  is  MIL-I-45208A. 

It  is  premature  to  tie  the  use  of  ISO  standards  to  the  Action  Plan. 

We  can  take  no  action  in  this  regard  until  the  Office  of  the  Secretary 
of  Defense  rescind  the  prohibition  on  using  ISO  as  a  substitute  for 
MIL-I-45208. 

The  ISO  9000  Quality  System  Standards  establishes  a  global  baseline  for 
Quality  Assurance  (QA)  in  design,  development,  production,  installation 
and  servicing.  They  were  developed  to  harmonize  the  large  number  of 
national  and  international  standards  in  the  field.  Focus  is  on  the 
supplier’s  documented  system  rather  than  on  the  inherent  ^ality  of  the 
system’s  products.  As  such,  implementation  of  ISO  9000  will  have  minimal 
impact  on  the  quality  of  spare  and  repair  parts  in  the  defense  inventojry. 

RECOMMENDATION  B.S.d;  We  recommend  that  the  Director,  Defense  Logistics 
Agency,  revise  the  Defense  Logistics  Agency  Action  Plan  to  add  an 
initiative  to  develop  training  for  Defense  Contract  Management  Command 
quality  assurance  representatives  on  how  to  evaluate  the  ISO  9000/Q90 
commercial  quality  systems  under  objective  12,  update  in-plant  Government 
quality  assurance  procedures  to  provide  Government  quality  assurance 
representatives  flexibility  to  tailor  oversight. 

DLiA  COMMENTS:  Nonconcur,  Although  the  Defense  Logistics  Agency  is 
developing  an  ISO  9000  training  product  to  educate  the  acquisition  work 
force,  the  scope  of  the  training  is  limited  to  the  application  of  ISO 
9001,  Quality  Systems  Model  for  Quality  Assurance  in  Design/Development, 
Production,  Installation,  and  Servicing.  The  objective  of  the  ISO  9001 
training  product  is  to  provide  an  understanding  of  the  standard  and  the 
minimal  impact  on  Defense  Contract  Management  Command  quality  assurance 
oversight.  The  addition  of  this  training  initiative  under  objective  12 
has  no  impact  on  the  DLA  Implementing  Action  Plans  for  Improving  the 
Quality  of  Spare  Parts. 

The  Assistant  Secretary  of  Defense  (Production  and  Logistics) ,  in  an 
April  2,  1993  memorandum,  specifically  limited  the  use  of  International 
Quality  Standards  to  acquisitions  where  MIL-Q-9858A,  Quality  Program 
Requirements,  would  be  applied.  The  application  of  MIL-Q-9858A/IS09001 
is  reserved  for  complex  acquisitions  as  determined  by  the  Contracting 
Officer.:  Since  the  DLA  Action  Plan  is  focused  on  improving  the  quality 
of  spare  parts  and  the  Defense  Supply  Centers/Military  buying  activities 
are  constrained  from  using  International  Quality  Series  Standards  for 
spare  parts,  then  a  training  initiative  to  educate  Defense  Supply  Center 
personnel  should  coincide  with  the  Department  of  Defense  authorization 
to  use  the  ISO  Quality  Series  Standards  in  the  acquisition  of  spare 
parts. 
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RECOMMENDATION  B.S.e:  We  recocunend  that  the  Director,  Defense  Logistics 
Agency,  revise  the  Defense  Logistics  Agency  Action  Plan  to  add  an 
initiative  to  measure  the  numbers  of  waivers  and  deviations  and  the 
number  of  Material  Review  Board  actions  that  are  approved  and  include 
that  information  in  the  Quality  Effectiveness  Sensing  Technique  under 
objective  10,  reduce  contractor  materiel  review  board  actions  and 
requests  for  waivers  or  deviations. 

DLA  COMMENTS:  Nonconcur.  Experience  has  shown  that  summaries  of 
waivers/deviations/MRB  data  are  just  not  good  measures.  An  up  or  down 
movement  in  these  numbers  does  not  necessarily  relate  to  deterioration  or 
improvement  in  the  contractor  base,  because  of  our  inability  to  normalize 
the  data.  As  the  finding  indicates,  we  have  been  collecting  data  on  the 
numbers  of  waivers  and  deviations  and  Material  Review  Board  (MRB)  actions 
for  many  years.  Data  is  stored  in  the  Quality  Assurance  Management 
Information  System  (QA  MIS),  and  extracted  for  the  Quality  Effectiveness 
Sensing  Technique  (QUEST)  .  We  are  now  reconsidering  the  viability  of 
QUEST;  we  have  serious  concerns  about  its  utility  as  a  risk  assessment 
tool.  Movements  in  such  numbers  often  occur  for  reasons  other  than 
deterioration  or  improvement  in  the  effectiveness  of  the  contractor 
inspection  systems  or  quality  assurance  programs.  For  example,  the 
number  of  waivers  may  go  up  because  a  contractor  improved  his  detection 
efforts,  or  even  conditions  beyond  the  contractor  control,  such  as 
imperfect  Government  furnished  technical  data,  defective  Government 
furnished  material,  general  power  failures  during  machining  operations, 
etc.  We  cannot  afford  to  rely  on  such  data  summaries  because  we  do  not 
know  what  movements  in  the  numbers  really  mean.  Furthermore,  these 
numbers  often  ignore  nonconforming  material  that  is  reworked  or  scrapped, 
and  might  never  appear  in  a  numerical  summary  of  waivers/deviations/MRB 
actions.  We  therefore  decided  to  rely  on  tbe  process  oriented  approach, 
because  it  more  completely,  directly,  and  efficiently  pursues  our  goal  of 
reducing  nonconforming  material.  Process  Oriented  Contract 
Administration  Services  (PROCAS)  focuses  individually  on  the  contractor 
processes  that  support  contract  performance.  Data  is  used  locally,  in 
the  plant,  where  we  can  understand  what  movements  in  Individual  process 
measurement  numbers  mean,  and  use  them  as  a  tool  to  improve  process 
performance,  thereby  reducing  the  production  of  nonconforming  material  of 
all  kinds.  Additionally,  we  will  continue  using  the  results  of  our  lab 
testing  efforts  as  indicators  of  overall  deterioration  or  improvement  in 
spare  parts  quality. 

RECOMMENDATION  B.B.f:  We  recommend  that  the  Director,  Defense  Logistics 
Agency,  revise  the  Defense  Logistics  Agency  Action  Plan  to  add  an 
objective  to  verify  that  inspection  procedures  for  repackaged  products 
are  applied  so  that  damaged  products  are  not  sent  out  and  that  all 
necessary  information  is  included  on  the  package  label  as  part  of 
the  depot  (supply  management)  phase. 

DLA  COMMENTS:  Nonconcur.  DLA  currently  has  a  program  where  en^loyees 
inspect  items  for  proper  packaging  and  marking  prior  to  shipment  to 
customers.  Our  review  of  data  supplied  from  the  IG  regarding  this 
finding  indicates  that  reported  problems  were  from  the  "Red  River  Army 
Depot".  Although  Red  River  is  now  a  DLA  depot  under  DMRD  902,  the  data 
indicates  that  these  problems  were  created  prior  to  consolidation.  Since 
consolidation.  Red  River  has  worked  to  resolve  these  problems  and  has  an 
inspection  program  in  place  to  verify  correction. 
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ADDENDUM  TO  THE  DLA  AH5FZNSBS  TO  THE 
FINDINGS  AND  RECOMMENDATICXS  TOR  THE  DOD  IG 

•Draft  Report  on  DoD  Component  ImpZeir.enting  Action  Plana  for 
improving  the  Quality  of  Spare  Parte  {Project  No.  2CF-0053) 


OTHER  COMMENTS  FROM  THE  DRAFT  AUDIT  REPORT: 


1.  Page  i,  2ndl  Paragraph,  ■Rowevar«  Banaganaat  effielale  reepoaaibla  for 
lapleaenting  the  motion  plana  and  for  achiaving  continuoua  quality 
inprovamente  are  iftot  accountable  for  tli«  adveraa  affeote  of  poor  quality." 

Response.  DLA  does  consider  itself  accountable  for  poor  quality  products 
provided  to  our  cuatomera.  Accountability:  In  taking  prudent  actions  to 
insure  that  our  custoners  gat  the  product  quality  expected;  in  inveati* 
gating  customer  conqplalnts  with  monetary  refunds  when  appropriate;  and# 
moat  Importantly#  in  working  as  a  full  partner  with  our  cuatoeiers  to  re¬ 
solve  quality  concerns  from  the  moat  critical  readiness  impacts  to  routine 
day-to-day  operational  considerations.  Xn  the  current  environment#  military 
and  federal  cuatomera  have  alternatives  to  using  OLA  for  many  of  their 
product  needs*  Our  future  existence  la  tied  to  being  tha  supplier  of 
choice  —  of  providing  our  customers  with  the  quality#  timeliness  and 
value  expected.  To  say  that  we  are  not  accountable  for  the  effects  of 
poor  quality  la  untrue. 

2*  Page  A,  Paragraph  "Internal  Controls  Reviewed*"  "nia  DoD  Coopoaai&ta  bad 
no  Internal  controls  in  thair  intemal  nanageaiant  control  program  to  addraaa 
ediathar  manageraant  offlolala  reviaad  and  up^tad  ioplemantlng  action  plana." 

Response:  DLA  disagrees  with  this  statement.  While  DLA  never  published 
another  hard-copy  edition  of  its  May  90  Action  Plan,  DLA#  including  the 
Deputy  Director  and  Primary  Staff  Element  managers#  used  an  automated 
version  to  track  Action  Plan  initiative  status.  Tha  Deputy  Director# 
at  least  quarterly,  questioned  updates  and  xade  requests  for  additional 
information.  Also,  Action  Plan  initiative  status  was  briefed  periodically 
to  the  DLA  staff  and  other  off  lei  ala  including  the  DoD  iG  staff.  At  theee 
briefings,  he  challenged  the  participants  to  go  beyond  the  published  Action 
Plan  and  pursue  additional  casks/mllestones.  These  ware  included  in  tha 
automated  version  of  the  Action  Plan  and/or  in  the  briefing  charts 
presented.  DLA* a  management,  with  only  a  short  lapse  during  the 
Headquarter  *  s  reorganization,  has  been  effective  and  resulted  in  batter 
product  quality  for  our  customers. 

3.  Page  5,  1st  Paragraph.  "The  Amy,  and,  ia  some  eases,  the  Navy  end  DZA 
ccnald  not  identify  the  offices  of  pclsery  respcmsibllity* " 

Response:  DLA  was  unaware  of  any  Offices  of  Primary  Responsibility  (OPRs) 
that  the  DoD  IQ  was  not  able  to  Identify  or  interview.  Additionally,  while 
there  may  have  been  some  temporary  delays  in  assigning  new  OPRs  during  the 
DLA  Headquarters  reorganization#  the  original  OPRs  were  still  available  and 
responsible  for  their  Action  Plan  initiatives.  DLA  canit  support  DoD  IG 
requests  if  we  are  unaware  of  problems  or  perceived  problems  during  an  on¬ 
going  audit.  It's  unfair  to  make  this  statement  without  supporting 
documentation.  VflA  had/has  OPRs  assigned  for  each  initiative  in  the  Kay  90 
DLA  Action  Plan  and  will  do  so  again  in  the  new  DLA  Action  Plan.  In 
addition,  each  Initiative  had  milestones  and  qualitative#  quantitative  or 
both  types  of  measures  to  track  progress  and  success.  This  combined  with 
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senior  management  involvement  and  the  auconuited  tracking  ayatem  provided 
strong  internal  managewent  of  the  DLA  Action  Plan. 

4.  Page  11,  2nd  Paragraph  under  "KBSPOMSXBXbttXBS  AMD  P1ZDBACK»*  "After 
tlie  reorganisations  and  staff  redustlocis«  we  detexsdiMid  that  the  BoD 
C<»^poiisnts  did  not  fomalXy  assign  or  reassign  rasponaihility  for  ell  of 
the  ohjedtives,  motions^  end  initiatives  in  their  laipleMniti^  notion 
plane.*  and  Page  12,  *DIiA”  paragraph.  "The  DXJk  Aotion  Plan  cited  the 
offices  of  primary  responsibility  for  all  2€  objeativss,  but  the  pointe  of 
eonteot  for  mix  objeetlvss  eould  net  answer  XmisIc  queetiona  and  did  not 
know  who  to  contact  to  obtain  mnmmrm  regarding  the  initiatlvea  under  the 
obj native. " 

Response:  The  DLA  Action  Plan  assigned  responsibility  for  the  objectives 
and  activities  to  Offices  of  Primary  Interest  (OPIe)  .  During  the  DLA 
Headquarter's  reorganisation  during  the  Mar-Hay  d3  timeframe,  meny  of  the 
OPXe  changed  including  the  Action  Plan  Primary  Point  of  Contact  (POC)  . 

DLA  anticipated  that  the  OoD  IG  may  face  some  difficulty  in  Interviewing 
OPio  and  requested,  on  a  number  of  occasions  including  the  official  Sn- 
brief,  to  notify  the  OLA  Audit  POC  to  work  any  problems  and/or  resolve 
any  difficulties.  Evidently  this  was  not  done  or  individual  members  of 
the  Audit  Team  imire  unaware  of  this  situation.  We  believe  this  issue 
could  have  been  resolved  immediately  by  working  through  the  DLA  Audit  POC. 

5.  Appendix  C  comments:  OLA  is  unclear  as  to  the  evaluative  criteria 
for  determining  initiative  and  objective  completion.  Heny  objectives  are 
meshed  into  our  key  business  processes  and  will  always  lequlre  management 
attention.  Typically  this  is  done  as  part  of  an  organlxaLlun's  strategic 
and  operational  plans  and  not  as  a  "Quality  Assurance"  Action  Plan.  An 
Aotion  Plan  ought  to  mean  that  iiBmediate  action  is  needed  to  resolve  known 
or  anticipated  problems.  Long  term  planning  needs  to  be  fully  integrated 
into  an  organisation's  strategic  and  business  plans. 

a.  Objective  2.  Rot  clear  why  this  objective  isn't  considered 
oocaplete  with  all  initiatives  by  all  DoD  CoBQponents  listed  as  complete. 

Are  you  saying  that  these  initiatives  did  not  meet  the  intended  objective? 

If  so,  vihat  criteria  were  used? 

b.  Objective  7.  DLA's  Initiative  under  this  objective  is  completed. 
From  an  Action  Plan  viewpoint,  the  objective  would  also  be  considered 
complete.  DLA  will  incorporate  this  objective/goal  into  our  normal  business 
practices  and,  if  required  at  a  future  date,  develop  an  Action  Plan  or  Action 
Plan  initiative  to  address  major  deficiencies. 

c.  Objective  22.  All  DLA  Action  Plan  initiatives  for  this  objective 
are  complete.  DLA  has  significantly  improved  its  Inventory  Control  Point 
(ICP)  laboratory  teating  program  and  increased  its  Internal  testing 
capacity.  While  the  laboratory  testing  program  will  continually  strive  for 
improvement,  the  urgent  Action  Plan  initiatives  are  complete.  Refinements 
to  the  testing  program  should  now  be  included  in  the  Agency's  and  ICP 
strategic  and  business  plans. 

ACTION  OFFICER:  Duane  Rice,  MMSLP,  617-0S06,  17  Dec  93 
rbvibw/APPRCTVAL:  James  J.  Orady,  Jr«,  Deputy  Executive 

Director,  Supply  Management,  MMSD,  x70510 
COORDINATION:  A.  Broadnax,  BDAI.  X49M->,  a/1^  .•ADCU-JB. 

DIA  APPROVAL,  . 
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